Sep 17 14:50:55 devstack cinder-volume[74661]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 17 14:50:55 devstack cinder-volume[74661]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 14:50:55 devstack cinder-volume[74661]: we strongly recommend against using it for new projects. Sep 17 14:50:55 devstack cinder-volume[74661]: If you are already using Eventlet, we recommend migrating to a different Sep 17 14:50:55 devstack cinder-volume[74661]: framework. For more detail see Sep 17 14:50:55 devstack cinder-volume[74661]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 14:50:55 devstack cinder-volume[74661]: import eventlet # noqa Sep 17 14:50:57 devstack cinder-volume[74661]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 14:50:57 devstack cinder-volume[74661]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 14:50:57 devstack cinder-volume[74661]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 14:50:58 devstack cinder-volume[74661]: INFO dbcounter [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Registered counter for database cinder Sep 17 14:50:58 devstack cinder-volume[74661]: DEBUG oslo_db.sqlalchemy.engines [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74661) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:50:58 devstack cinder-volume[74661]: DEBUG dbcounter [-] [74661] Writer thread running {{(pid=74661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 14:50:58 devstack cinder-volume[74661]: INFO cinder.rpc [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 14:50:58 devstack cinder-volume[74661]: INFO cinder.rpc [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 14:50:58 devstack cinder-volume[74661]: DEBUG oslo_db.sqlalchemy.engines [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74661) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:50:59 devstack cinder-volume[74661]: INFO cinder.volume.manager [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Determined volume DB was empty at startup. Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG cinder.volume.manager [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74661) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 17 14:50:59 devstack cinder-volume[74661]: INFO cinder.volume.manager [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 17 14:50:59 devstack cinder-volume[74661]: WARNING stevedore.named [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 14:50:59 devstack cinder-volume[74661]: WARNING castellan.key_manager [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 14:50:59 devstack cinder-volume[74661]: WARNING cinder.keymgr.conf_key_mgr [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG cinder.volume.drivers.lvm [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74661) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_concurrency.processutils [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_concurrency.processutils [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] CMD "cinder-rtstool verify" returned: 0 in 0.555s {{(pid=74661) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_db.sqlalchemy.engines [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74661) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:50:59 devstack cinder-volume[74661]: INFO cinder.rpc [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 17 14:50:59 devstack cinder-volume[74661]: INFO cinder.rpc [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 17 14:50:59 devstack cinder-volume[74661]: WARNING stevedore.named [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 14:50:59 devstack cinder-volume[74661]: WARNING castellan.key_manager [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 14:50:59 devstack cinder-volume[74661]: INFO cinder.volume.manager [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_db.sqlalchemy.engines [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74661) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:50:59 devstack cinder-volume[74661]: INFO oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Starting 1 workers Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Started child 74858 {{(pid=74661) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Full set of CONF: {{(pid=74661) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] ******************************************************************************** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Configuration options gathered from: {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] ================================================================================ {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] allow_availability_zone_fallback = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] allow_compression_on_image_upload = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] allowed_direct_url_schemes = [] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] api_rate_limit = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] auth_strategy = keystone {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] az_cache_duration = 3600 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_availability_zone = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_host = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_name = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_stats_polling_interval = 60 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backup_api_class = cinder.backup.api.API {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backup_name_template = backup-%s {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backup_use_same_host = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backup_use_temp_snapshot = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] chap_password = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] chap_username = {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cinder_internal_tenant_project_id = 4b0b9e82161a43968d854c93fe133b58 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cinder_internal_tenant_user_id = dc1fc07d8cb242e98ac6afb8a3d16bfe {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cloned_volume_same_az = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cluster = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] compression_format = gzip {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] compute_api_class = cinder.compute.nova.API {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] config_dir = [] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] config_source = [] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] control_exchange = openstack {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] debug = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] default_availability_zone = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] default_group_type = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] default_volume_type = lvmdriver-1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] disk_geometry = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] driver_client_cert = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] driver_client_cert_key = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] driver_data_namespace = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74858]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] driver_ssl_cert_path = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] driver_ssl_cert_verify = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] driver_use_ssl = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] enable_force_upload = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] enable_new_services = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] enable_unsupported_driver = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] enabled_backends = ['lvmdriver-1'] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] enforce_multipath_for_image_xfer = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] filter_function = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance_api_insecure = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance_api_servers = ['http://192.168.122.40/image'] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance_api_ssl_compression = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance_ca_certificates_file = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance_catalog_info = image:glance:publicURL {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance_certfile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance_keyfile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance_num_retries = 3 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance_request_timeout = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] goodness_function = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] graceful_shutdown_timeout = 5 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] group_api_class = cinder.group.api.API {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] host = devstack {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] image_compress_on_upload = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] image_conversion_address_space_limit = 1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] image_conversion_cpu_limit = 60 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] image_conversion_disable = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] image_introspection_address_space_limit = 1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] image_introspection_cpu_limit = 60 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] image_upload_use_cinder_backend = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] image_upload_use_internal_tenant = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] image_volume_cache_enabled = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] image_volume_cache_max_count = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] image_volume_cache_max_size_gb = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] init_host_max_objects_retrieval = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] instance_format = [instance: %(uuid)s] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] iscsi_target_flags = {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] iscsi_write_cache = on {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] iser_helper = tgtadm {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] iser_ip_address = 192.168.122.40 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] iser_port = 3260 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] log_color = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] log_config_append = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] log_dir = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] log_file = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] log_options = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] log_rotate_interval = 1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] log_rotate_interval_type = days {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] log_rotation_type = none {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] max_age = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] max_logfile_count = 30 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] max_logfile_size_mb = 200 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] max_over_subscription_ratio = 20.0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] message_reap_interval = 86400 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] message_ttl = 2592000 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] migration_create_volume_timeout_secs = 300 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] monkey_patch = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] monkey_patch_modules = [] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] my_ip = 192.168.122.40 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] no_snapshot_gb_quota = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] num_iser_scan_tries = 3 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] num_shell_tries = 3 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] num_volume_device_scan_tries = 3 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] nvmeof_conn_info_version = 1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] nvmet_ns_id = 10 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] nvmet_port_id = 1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] osapi_max_limit = 1000 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] osapi_volume_ext_list = [] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] osapi_volume_listen = 0.0.0.0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] osapi_volume_listen_port = 8776 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] osapi_volume_use_ssl = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] osapi_volume_workers = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] per_volume_size_limit = -1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] periodic_fuzzy_delay = 60 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] periodic_interval = 60 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] project_id_regex = [0-9a-f\-]+ {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] public_endpoint = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] publish_errors = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] quota_backup_gigabytes = 1000 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] quota_backups = 10 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] quota_gigabytes = 1000 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] quota_groups = 10 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] quota_snapshots = 10 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] quota_volumes = 10 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] rate_limit_burst = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] rate_limit_except_level = CRITICAL {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] rate_limit_interval = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] reinit_driver_count = 3 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] replication_device = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] report_discard_supported = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] report_interval = 120 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] reservation_clean_interval = 86400 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] reservation_expire = 86400 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] reserved_image_namespaces = [] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] reserved_percentage = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] rpc_response_timeout = 120 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] run_external_periodic_tasks = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] scst_target_driver = iscsi {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] scst_target_iqn_name = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] service_down_time = 720 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] shell_completion = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] snapshot_name_template = snapshot-%s {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] snapshot_same_host = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] split_loggers = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] state_path = /opt/stack/data/cinder {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] storage_availability_zone = nova {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] storage_protocol = iSCSI {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] syslog_log_facility = LOG_USER {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] target_helper = lioadm {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] target_ip_address = 192.168.122.40 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] target_port = 3260 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] target_protocol = iscsi {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] target_secondary_ip_addresses = [] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] trace_flags = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] transfer_api_class = cinder.transfer.api.API {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] transport_url = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] until_refresh = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] use_chap_auth = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] use_default_quota_class = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] use_journal = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] use_json = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] use_multipath_for_image_xfer = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] use_stderr = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] use_syslog = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] verify_glance_signatures = enabled {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] volume_api_class = cinder.volume.api.API {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] volume_backend_name = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] volume_clear = zero {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] volume_clear_ionice = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] volume_clear_size = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] volume_copy_bps_limit = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] volume_dd_blocksize = 1M {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] volume_name_template = volume-%s {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] volume_service_inithost_offload = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] volume_usage_audit_period = month {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] zoning_mode = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_concurrency.disable_process_locking = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74858]: INFO cinder.volume.manager [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.auth_section = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.auth_type = password {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.auth_version = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.cache = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.certfile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.include_service_catalog = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.insecure = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.interface = public {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.keyfile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.memcache_password = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.memcache_username = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.region_name = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.service_token_roles_required = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.service_type = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.40/identity {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.backend = dogpile.cache.null {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.backend_argument = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.backend_expiration_time = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.config_prefix = cache.oslo {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.debug_cache_backend = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.enable_retry_client = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.enable_socket_keepalive = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.enabled = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.expiration_time = 600 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.hashclient_retry_attempts = 2 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.memcache_dead_retry = 300 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.memcache_pool_maxsize = 10 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.memcache_sasl_enabled = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.password = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.proxies = [] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.redis_db = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.redis_server = localhost:6379 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.retry_attempts = 2 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.retry_delay = 0.0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.socket_keepalive_count = 1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.socket_keepalive_idle = 1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.socket_keepalive_interval = 1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.socket_timeout = 1.0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.tls_allowed_ciphers = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.tls_cafile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.tls_certfile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.tls_enabled = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.tls_keyfile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cache.username = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] coordination.backend_url = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.asyncio_connection = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.asyncio_slave_connection = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.backend = sqlalchemy {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.connection = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.connection_debug = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.connection_parameters = {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.connection_recycle_time = 3600 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.connection_trace = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.db_inc_retry_interval = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.db_max_retries = 20 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.db_max_retry_interval = 10 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.db_retry_interval = 1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.max_overflow = 50 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.max_pool_size = 5 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.max_retries = 10 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.mysql_wsrep_sync_wait = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.pool_timeout = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.retry_interval = 10 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.slave_connection = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.sqlite_synchronous = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.synchronous_reader = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] database.use_db_reconnect = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_tracing.insecure = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] profiler.connection_string = messaging:// {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] profiler.enabled = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] profiler.es_doc_type = notification {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] profiler.es_scroll_size = 10000 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] profiler.es_scroll_time = 2m {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] profiler.filter_error_trace = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] profiler.hmac_keys = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] profiler.sentinel_service_name = mymaster {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] profiler.socket_timeout = 0.1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] profiler.trace_requests = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] profiler.trace_sqlalchemy = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] profiler_jaeger.process_tags = {} {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] profiler_jaeger.service_name_prefix = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] profiler_otlp.service_name_prefix = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_policy.enforce_new_defaults = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_policy.policy_default_rule = default {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_policy.policy_file = policy.yaml {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.063s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:50:59 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_policy.remote_timeout = 60.0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] privsep_osbrick.group = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] privsep_osbrick.helper_command = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:50:59 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] privsep_osbrick.user = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cinder_sys_admin.group = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cinder_sys_admin.helper_command = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] cinder_sys_admin.user = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] service_user.auth_section = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] service_user.auth_type = password {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] service_user.cafile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] service_user.certfile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] service_user.collect_timing = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] service_user.insecure = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] service_user.keyfile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] service_user.send_service_user_token = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] service_user.split_loggers = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] service_user.timeout = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] service_user.tls_ciphers = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] service_user.tls_min_version = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance.auth_section = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance.auth_type = password {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance.certfile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance.collect_timing = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance.insecure = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance.keyfile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance.region_name = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance.split_loggers = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance.timeout = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance.tls_ciphers = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] glance.tls_min_version = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.backend_availability_zone = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.chap_password = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.chap_username = {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.disk_geometry = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.driver_client_cert = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.driver_client_cert_key = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.driver_data_namespace = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.driver_use_ssl = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.extra_capabilities = {} {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.filter_function = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.goodness_function = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.iscsi_target_flags = {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.iscsi_write_cache = on {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.iser_helper = tgtadm {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.iser_ip_address = 192.168.122.40 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.iser_port = 3260 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.lvm_mirrors = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.lvm_share_target = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.lvm_type = auto {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.num_shell_tries = 3 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.replication_device = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.report_discard_supported = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.reserved_percentage = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.target_helper = tgtadm {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.target_ip_address = 192.168.122.40 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.target_port = 3260 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.target_protocol = iscsi {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.trace_flags = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.unique_fqdn_network = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.use_chap_auth = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.volume_backend_name = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.volume_clear = zero {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.volume_clear_ionice = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.volume_clear_size = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.volume_group = cinder-volumes {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_reports.file_event_handler = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_reports.log_dir = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:00 devstack sudo[74862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.backend_host = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack sudo[74862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:00 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.chap_password = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.chap_username = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.chiscsi_conf = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.disk_geometry = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.driver_client_cert = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.driver_use_ssl = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.extra_capabilities = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.filter_function = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.goodness_function = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.iser_helper = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.iser_ip_address = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.iser_port = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.lvm_conf_file = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.lvm_mirrors = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.lvm_share_target = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.lvm_type = auto {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.num_shell_tries = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.nvmet_port_id = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.replication_device = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.report_discard_supported = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.reserved_percentage = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.scst_target_driver = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.storage_protocol = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.target_helper = lioadm {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.target_ip_address = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.target_port = 3260 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.target_protocol = iscsi {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.trace_flags = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.use_chap_auth = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.volume_clear = zero {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.volume_clear_size = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] lvmdriver-1.volumes_dir = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.ssl = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.ssl_version = {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_notifications.driver = [] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_notifications.retry = -1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] key_manager.fixed_key = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.barbican_api_version = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.barbican_endpoint = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.barbican_endpoint_type = public {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.barbican_region_name = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.cafile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.certfile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.collect_timing = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.insecure = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.keyfile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.number_of_retries = 60 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.retry_delay = 1 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.send_service_user_token = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.split_loggers = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.timeout = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.tls_ciphers = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.tls_min_version = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.verify_ssl = True {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican.verify_ssl_path = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican_service_user.auth_section = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican_service_user.auth_type = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican_service_user.cafile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican_service_user.certfile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican_service_user.collect_timing = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican_service_user.insecure = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican_service_user.keyfile = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican_service_user.split_loggers = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican_service_user.timeout = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican_service_user.tls_ciphers = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] barbican_service_user.tls_min_version = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] vault.approle_role_id = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] vault.approle_secret_id = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] vault.auth_method = approle {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] vault.auth_path = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] vault.kv_mountpoint = secret {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] vault.kv_path = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] vault.kv_version = 2 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] vault.namespace = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] vault.root_token_id = **** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] vault.ssl_ca_crt_file = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] vault.timeout = 60.0 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] vault.token_file = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] vault.token_role = None {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] vault.use_ssl = False {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:00 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] ******************************************************************************** {{(pid=74661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 17 14:51:00 devstack sudo[74862]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:00 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.327s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:00 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:00 devstack sudo[74865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:51:00 devstack sudo[74865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:00 devstack sudo[74865]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:00 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.295s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:00 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 14:51:00 devstack cinder-volume[74858]: INFO cinder.brick.local_dev.lvm [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 17 14:51:00 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:00 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:00 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:00 devstack sudo[75002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 14:51:00 devstack sudo[75002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:00 devstack sudo[75002]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:00 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:00 devstack cinder-volume[74858]: DEBUG cinder.brick.local_dev.lvm [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=74858) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 17 14:51:00 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:01 devstack sudo[75095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:51:01 devstack sudo[75095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:01 devstack sudo[75095]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:01 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.525s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:01 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:01 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:01 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:01 devstack sudo[75285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:51:01 devstack sudo[75285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:01 devstack sudo[75285]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:01 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:01 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:01 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:01 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:01 devstack sudo[75386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 17 14:51:01 devstack sudo[75386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:02 devstack sudo[75386]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:02 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.314s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:02 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:02 devstack sudo[75475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 14:51:02 devstack sudo[75475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:02 devstack sudo[75475]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:02 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:02 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:02 devstack sudo[75479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 14:51:02 devstack sudo[75479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:02 devstack sudo[75479]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:02 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:02 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:02 devstack sudo[75561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:51:02 devstack sudo[75561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:02 devstack sudo[75561]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:02 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:02 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:03 devstack sudo[75569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:51:03 devstack sudo[75569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:03 devstack sudo[75569]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:03 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.311s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:03 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:03 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:03 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:03 devstack sudo[75653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:51:03 devstack sudo[75653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:03 devstack sudo[75653]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:03 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:03 devstack cinder-volume[74858]: INFO cinder.volume.drivers.lvm [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 17 14:51:03 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:03 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:03 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:03 devstack sudo[75658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:51:03 devstack sudo[75658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:03 devstack sudo[75658]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:03 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:03 devstack cinder-volume[74858]: DEBUG cinder.volume.drivers.lvm [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Updating volume stats {{(pid=74858) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 14:51:03 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:03 devstack sudo[75661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 14:51:03 devstack sudo[75661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:04 devstack sudo[75661]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:04 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:04 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:04 devstack sudo[75670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:51:04 devstack sudo[75670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:04 devstack sudo[75670]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:04 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:04 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:04 devstack sudo[75673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:51:04 devstack sudo[75673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:04 devstack sudo[75673]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:04 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:04 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:04 devstack sudo[75676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:51:04 devstack sudo[75676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:04 devstack sudo[75676]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:04 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:04 devstack cinder-volume[74858]: INFO cinder.volume.driver [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Driver hasn't implemented _init_vendor_properties() Sep 17 14:51:04 devstack cinder-volume[74858]: DEBUG cinder.volume.driver [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=74858) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 17 14:51:05 devstack cinder-volume[74858]: DEBUG oslo_db.sqlalchemy.engines [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74858) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:51:05 devstack cinder-volume[74858]: DEBUG dbcounter [-] [74858] Writer thread running {{(pid=74858) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 14:51:05 devstack cinder-volume[74858]: DEBUG cinder.db.api [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Building query based on filter {{(pid=74858) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 17 14:51:05 devstack cinder-volume[74858]: DEBUG cinder.image.image_utils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=74858) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 17 14:51:05 devstack cinder-volume[74858]: INFO cinder.keymgr.migration [None req-67579014-02f4-4743-9963-79cecbe9a4f3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 14:51:05 devstack cinder-volume[74858]: DEBUG cinder.volume.drivers.lvm [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Updating volume stats {{(pid=74858) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 14:51:05 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:05 devstack sudo[75679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 14:51:05 devstack sudo[75679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:05 devstack sudo[75679]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:05 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:05 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:05 devstack sudo[75683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:51:05 devstack sudo[75683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:05 devstack sudo[75683]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:05 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:05 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:05 devstack sudo[75687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:51:05 devstack sudo[75687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:05 devstack sudo[75687]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:05 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:05 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:05 devstack sudo[75690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:51:05 devstack sudo[75690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:06 devstack sudo[75690]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:06 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:06 devstack cinder-volume[74858]: DEBUG cinder.manager [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Notifying Schedulers of capabilities ... {{(pid=74858) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:51:06 devstack cinder-volume[74858]: INFO cinder.volume.manager [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Driver initialization completed successfully. Sep 17 14:51:06 devstack cinder-volume[74858]: INFO cinder.manager [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Initiating service 2 cleanup Sep 17 14:51:06 devstack cinder-volume[74858]: INFO cinder.manager [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Service 2 cleanup completed. Sep 17 14:51:06 devstack cinder-volume[74858]: DEBUG cinder.service [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Creating RPC server for service cinder-volume {{(pid=74858) start /opt/stack/cinder/cinder/service.py:231}} Sep 17 14:51:06 devstack cinder-volume[74858]: DEBUG cinder.service [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=74858) start /opt/stack/cinder/cinder/service.py:237}} Sep 17 14:51:06 devstack cinder-volume[74858]: INFO cinder.volume.manager [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 17 14:51:06 devstack cinder-volume[74858]: DEBUG cinder.volume.drivers.lvm [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Updating volume stats {{(pid=74858) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 14:51:06 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:06 devstack sudo[75694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 14:51:06 devstack sudo[75694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:06 devstack sudo[75694]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:06 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:06 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:06 devstack sudo[75699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:51:06 devstack sudo[75699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:06 devstack sudo[75699]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:06 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:06 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:06 devstack sudo[75702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:51:06 devstack sudo[75702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:07 devstack sudo[75702]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:07 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:07 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:07 devstack sudo[75705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:51:07 devstack sudo[75705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:07 devstack sudo[75705]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:07 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:07 devstack cinder-volume[74858]: INFO cinder.volume.manager [None req-92e63b91-3a7c-4b16-8417-576cb1c59667 None None] Driver post RPC initialization completed successfully. Sep 17 14:51:09 devstack cinder-volume[74661]: DEBUG dbcounter [-] [74661] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:51:17 devstack cinder-volume[74858]: DEBUG dbcounter [-] [74858] Writing DB stats cinder:SELECT=2 {{(pid=74858) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:51:17 devstack cinder-volume[74858]: DEBUG dbcounter [-] [74858] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=74858) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:51:41 devstack cinder-volume[74858]: DEBUG oslo_service.periodic_task [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Running periodic task VolumeManager._thread_info {{(pid=74858) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:51:41 devstack cinder-volume[74858]: DEBUG cinder.volume.manager [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] thread count: 6 {{(pid=74858) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 14:51:41 devstack cinder-volume[74858]: DEBUG cinder.volume.manager [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] thread info: [<_MainThread(MainThread, started 134076737654912)>, , , , , ] {{(pid=74858) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 14:52:41 devstack cinder-volume[74858]: DEBUG oslo_service.periodic_task [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74858) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:52:41 devstack cinder-volume[74858]: DEBUG cinder.volume.drivers.lvm [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Updating volume stats {{(pid=74858) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 14:52:41 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:52:41 devstack sudo[80871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 14:52:41 devstack sudo[80871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:52:41 devstack sudo[80871]: pam_unix(sudo:session): session closed for user root Sep 17 14:52:41 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:52:41 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:52:41 devstack sudo[80876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:52:41 devstack sudo[80876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:52:42 devstack sudo[80876]: pam_unix(sudo:session): session closed for user root Sep 17 14:52:42 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:52:42 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:52:42 devstack sudo[80880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:52:42 devstack sudo[80880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:52:42 devstack sudo[80880]: pam_unix(sudo:session): session closed for user root Sep 17 14:52:42 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:52:42 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:52:42 devstack sudo[80883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:52:42 devstack sudo[80883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:52:42 devstack sudo[80883]: pam_unix(sudo:session): session closed for user root Sep 17 14:52:42 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:52:42 devstack cinder-volume[74858]: DEBUG cinder.manager [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Notifying Schedulers of capabilities ... {{(pid=74858) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:52:42 devstack cinder-volume[74858]: DEBUG oslo_service.periodic_task [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Running periodic task VolumeManager._thread_info {{(pid=74858) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:52:42 devstack cinder-volume[74858]: DEBUG cinder.volume.manager [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] thread count: 6 {{(pid=74858) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 14:52:42 devstack cinder-volume[74858]: DEBUG cinder.volume.manager [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] thread info: [<_MainThread(MainThread, started 134076737654912)>, , , , , ] {{(pid=74858) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 14:53:17 devstack cinder-volume[74858]: DEBUG dbcounter [-] [74858] Writing DB stats cinder:SELECT=1 {{(pid=74858) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:53:17 devstack cinder-volume[74858]: DEBUG dbcounter [-] [74858] Writing DB stats cinder:UPDATE=1 {{(pid=74858) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:53:41 devstack cinder-volume[74858]: DEBUG oslo_service.periodic_task [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74858) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:53:41 devstack cinder-volume[74858]: DEBUG cinder.volume.drivers.lvm [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Updating volume stats {{(pid=74858) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 14:53:41 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:53:41 devstack sudo[82384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 14:53:41 devstack sudo[82384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:53:41 devstack sudo[82384]: pam_unix(sudo:session): session closed for user root Sep 17 14:53:41 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:53:41 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:53:41 devstack sudo[82387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:53:41 devstack sudo[82387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:53:42 devstack sudo[82387]: pam_unix(sudo:session): session closed for user root Sep 17 14:53:42 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:53:42 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:53:42 devstack sudo[82390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:53:42 devstack sudo[82390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:53:42 devstack sudo[82390]: pam_unix(sudo:session): session closed for user root Sep 17 14:53:42 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:53:42 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:53:42 devstack sudo[82394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:53:42 devstack sudo[82394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:53:42 devstack sudo[82394]: pam_unix(sudo:session): session closed for user root Sep 17 14:53:42 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:53:42 devstack cinder-volume[74858]: DEBUG cinder.manager [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Notifying Schedulers of capabilities ... {{(pid=74858) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:53:42 devstack cinder-volume[74858]: DEBUG oslo_service.periodic_task [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Running periodic task VolumeManager._thread_info {{(pid=74858) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:53:42 devstack cinder-volume[74858]: DEBUG cinder.volume.manager [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] thread count: 6 {{(pid=74858) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 14:53:42 devstack cinder-volume[74858]: DEBUG cinder.volume.manager [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] thread info: [<_MainThread(MainThread, started 134076737654912)>, , , , , ] {{(pid=74858) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 14:54:41 devstack cinder-volume[74858]: DEBUG oslo_service.periodic_task [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74858) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:54:41 devstack cinder-volume[74858]: DEBUG cinder.volume.drivers.lvm [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Updating volume stats {{(pid=74858) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 14:54:41 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:54:41 devstack sudo[83886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 14:54:41 devstack sudo[83886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:54:41 devstack sudo[83886]: pam_unix(sudo:session): session closed for user root Sep 17 14:54:41 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:54:41 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:54:41 devstack sudo[83889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:54:41 devstack sudo[83889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:54:42 devstack sudo[83889]: pam_unix(sudo:session): session closed for user root Sep 17 14:54:42 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:54:42 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:54:42 devstack sudo[83893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:54:42 devstack sudo[83893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:54:42 devstack sudo[83893]: pam_unix(sudo:session): session closed for user root Sep 17 14:54:42 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:54:42 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:54:42 devstack sudo[83906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:54:42 devstack sudo[83906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:54:42 devstack sudo[83906]: pam_unix(sudo:session): session closed for user root Sep 17 14:54:42 devstack cinder-volume[74858]: DEBUG oslo_concurrency.processutils [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=74858) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:54:42 devstack cinder-volume[74858]: DEBUG cinder.manager [None req-f120b753-1b39-4e27-a5d8-827fbb6b4072 None None] Notifying Schedulers of capabilities ... {{(pid=74858) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:55:17 devstack cinder-volume[74858]: DEBUG dbcounter [-] [74858] Writing DB stats cinder:SELECT=1 {{(pid=74858) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:55:17 devstack cinder-volume[74858]: DEBUG dbcounter [-] [74858] Writing DB stats cinder:UPDATE=1 {{(pid=74858) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:55:24 devstack cinder-volume[74661]: INFO oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Caught SIGTERM, stopping children Sep 17 14:55:24 devstack cinder-volume[74661]: DEBUG oslo_concurrency.lockutils [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Acquiring lock "singleton_lock" {{(pid=74661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 14:55:24 devstack cinder-volume[74661]: DEBUG oslo_concurrency.lockutils [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Acquired lock "singleton_lock" {{(pid=74661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 14:55:24 devstack cinder-volume[74661]: DEBUG oslo_concurrency.lockutils [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Releasing lock "singleton_lock" {{(pid=74661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 14:55:24 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Stop services. {{(pid=74661) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 17 14:55:24 devstack cinder-volume[74661]: DEBUG oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Killing children. {{(pid=74661) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 17 14:55:24 devstack cinder-volume[74661]: INFO oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Waiting on 1 children to exit Sep 17 14:55:26 devstack cinder-volume[74858]: DEBUG oslo_concurrency.lockutils [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Acquiring lock "singleton_lock" {{(pid=74858) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 14:55:26 devstack cinder-volume[74858]: DEBUG oslo_concurrency.lockutils [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Acquired lock "singleton_lock" {{(pid=74858) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 14:55:26 devstack cinder-volume[74858]: DEBUG oslo_concurrency.lockutils [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Releasing lock "singleton_lock" {{(pid=74858) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 14:55:26 devstack cinder-volume[74858]: WARNING amqp [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 14:55:26 devstack cinder-volume[74858]: WARNING amqp [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 14:55:26 devstack cinder-volume[74661]: INFO oslo_service.backend._eventlet.service [None req-b0c48e24-4c7d-40f8-a258-093d11100e60 None None] Child 74858 exited with status 0 Sep 17 14:55:26 devstack cinder-volume[85266]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 17 14:55:26 devstack cinder-volume[85266]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 14:55:26 devstack cinder-volume[85266]: we strongly recommend against using it for new projects. Sep 17 14:55:26 devstack cinder-volume[85266]: If you are already using Eventlet, we recommend migrating to a different Sep 17 14:55:26 devstack cinder-volume[85266]: framework. For more detail see Sep 17 14:55:26 devstack cinder-volume[85266]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 14:55:26 devstack cinder-volume[85266]: import eventlet # noqa Sep 17 14:55:28 devstack cinder-volume[85266]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85266) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 14:55:28 devstack cinder-volume[85266]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85266) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 14:55:28 devstack cinder-volume[85266]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85266) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 14:55:29 devstack cinder-volume[85266]: INFO dbcounter [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Registered counter for database cinder Sep 17 14:55:29 devstack cinder-volume[85266]: DEBUG oslo_db.sqlalchemy.engines [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85266) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:55:29 devstack cinder-volume[85266]: DEBUG dbcounter [-] [85266] Writer thread running {{(pid=85266) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 14:55:29 devstack cinder-volume[85266]: INFO cinder.rpc [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 14:55:29 devstack cinder-volume[85266]: INFO cinder.rpc [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 14:55:29 devstack cinder-volume[85266]: DEBUG oslo_db.sqlalchemy.engines [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85266) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:55:29 devstack cinder-volume[85266]: INFO cinder.volume.manager [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Determined volume DB was empty at startup. Sep 17 14:55:29 devstack cinder-volume[85266]: DEBUG cinder.volume.manager [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85266) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 17 14:55:29 devstack cinder-volume[85266]: INFO cinder.volume.manager [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 17 14:55:29 devstack cinder-volume[85266]: WARNING stevedore.named [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 14:55:29 devstack cinder-volume[85266]: WARNING castellan.key_manager [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 14:55:29 devstack cinder-volume[85266]: WARNING cinder.keymgr.conf_key_mgr [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 14:55:29 devstack cinder-volume[85266]: INFO cinder.volume.manager [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_db.sqlalchemy.engines [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85266) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:55:30 devstack cinder-volume[85266]: INFO oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Starting 1 workers Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Started child 85481 {{(pid=85266) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Full set of CONF: {{(pid=85266) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] ******************************************************************************** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Configuration options gathered from: {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] ================================================================================ {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] allow_availability_zone_fallback = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85481]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] allow_compression_on_image_upload = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] allowed_direct_url_schemes = [] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] api_rate_limit = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] auth_strategy = keystone {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_availability_zone = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_host = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_name = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_stats_polling_interval = 60 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backup_api_class = cinder.backup.api.API {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backup_name_template = backup-%s {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backup_use_same_host = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backup_use_temp_snapshot = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] chap_password = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] chap_username = {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cinder_internal_tenant_project_id = 4b0b9e82161a43968d854c93fe133b58 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cinder_internal_tenant_user_id = dc1fc07d8cb242e98ac6afb8a3d16bfe {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cluster = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] compression_format = gzip {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] compute_api_class = cinder.compute.nova.API {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] config_dir = [] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] config_source = [] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] control_exchange = openstack {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] debug = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] default_availability_zone = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] default_group_type = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] default_volume_type = QuobyteHD {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] disk_geometry = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] driver_client_cert = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] driver_client_cert_key = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] driver_data_namespace = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] driver_ssl_cert_path = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] driver_ssl_cert_verify = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] driver_use_ssl = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] enable_new_services = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] enable_unsupported_driver = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] enabled_backends = ['QuobyteHD'] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] enforce_multipath_for_image_xfer = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] filter_function = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance_api_insecure = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance_api_servers = ['http://192.168.122.40/image'] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance_api_ssl_compression = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance_ca_certificates_file = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance_catalog_info = image:glance:publicURL {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance_certfile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance_keyfile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance_num_retries = 3 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance_request_timeout = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] goodness_function = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] graceful_shutdown_timeout = 5 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] group_api_class = cinder.group.api.API {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] host = devstack {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] image_compress_on_upload = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] image_conversion_address_space_limit = 1 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] image_conversion_cpu_limit = 60 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] image_conversion_disable = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] image_introspection_address_space_limit = 1 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] image_introspection_cpu_limit = 60 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] image_upload_use_cinder_backend = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] image_upload_use_internal_tenant = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] image_volume_cache_enabled = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] image_volume_cache_max_count = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] image_volume_cache_max_size_gb = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] init_host_max_objects_retrieval = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] instance_format = [instance: %(uuid)s] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] iscsi_target_flags = {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] iscsi_write_cache = on {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] iser_helper = tgtadm {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] iser_ip_address = 192.168.122.40 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] iser_port = 3260 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] log_color = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] log_config_append = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85481]: INFO cinder.volume.manager [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Starting volume driver QuobyteDriver (1.2.1) Sep 17 14:55:30 devstack cinder-volume[85481]: DEBUG cinder.volume.drivers.remotefs [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85481) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] log_dir = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] log_file = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] log_options = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] log_rotate_interval = 1 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] log_rotate_interval_type = days {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] log_rotation_type = none {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] max_age = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] max_logfile_count = 30 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] max_logfile_size_mb = 200 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] max_over_subscription_ratio = 20.0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] message_reap_interval = 86400 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] message_ttl = 2592000 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] migration_create_volume_timeout_secs = 300 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] monkey_patch = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] monkey_patch_modules = [] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] my_ip = 192.168.122.40 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] no_snapshot_gb_quota = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] num_iser_scan_tries = 3 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] num_shell_tries = 3 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] num_volume_device_scan_tries = 3 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] nvmeof_conn_info_version = 1 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] nvmet_ns_id = 10 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] nvmet_port_id = 1 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] osapi_max_limit = 1000 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] osapi_volume_ext_list = [] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] osapi_volume_listen_port = 8776 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] osapi_volume_use_ssl = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] osapi_volume_workers = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] per_volume_size_limit = -1 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] periodic_fuzzy_delay = 60 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] periodic_interval = 60 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] public_endpoint = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] publish_errors = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] quota_backup_gigabytes = 1000 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] quota_backups = 10 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] quota_gigabytes = 1000 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] quota_groups = 10 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] quota_snapshots = 10 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] quota_volumes = 10 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] rate_limit_burst = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] rate_limit_except_level = CRITICAL {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] rate_limit_interval = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] reinit_driver_count = 3 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] replication_device = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] report_discard_supported = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] report_interval = 120 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] reservation_clean_interval = 86400 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] reservation_expire = 86400 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] reserved_image_namespaces = [] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] reserved_percentage = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] rpc_response_timeout = 120 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] run_external_periodic_tasks = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] scst_target_driver = iscsi {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] scst_target_iqn_name = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] service_down_time = 720 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] shell_completion = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] snapshot_name_template = snapshot-%s {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] split_loggers = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] state_path = /opt/stack/data/cinder {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] storage_availability_zone = nova {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] storage_protocol = iSCSI {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] syslog_log_facility = LOG_USER {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] target_helper = lioadm {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] target_ip_address = 192.168.122.40 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] target_port = 3260 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] target_protocol = iscsi {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] target_secondary_ip_addresses = [] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] trace_flags = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] transport_url = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] until_refresh = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] use_chap_auth = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] use_default_quota_class = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] use_journal = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] use_json = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] use_multipath_for_image_xfer = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] use_stderr = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] use_syslog = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] verify_glance_signatures = enabled {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] volume_api_class = cinder.volume.api.API {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] volume_backend_name = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] volume_clear = zero {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] volume_clear_ionice = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] volume_clear_size = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] volume_copy_bps_limit = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] volume_dd_blocksize = 1M {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] volume_name_template = volume-%s {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] volume_service_inithost_offload = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] volume_usage_audit_period = month {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] zoning_mode = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_concurrency.disable_process_locking = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.auth_section = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.auth_type = password {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.auth_version = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.cache = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.certfile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.include_service_catalog = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.insecure = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.interface = public {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.keyfile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.memcache_password = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.memcache_username = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.region_name = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.service_type = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.40/identity {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.backend = dogpile.cache.null {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.backend_argument = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.backend_expiration_time = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.config_prefix = cache.oslo {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.debug_cache_backend = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.enable_retry_client = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.enable_socket_keepalive = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.enabled = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.expiration_time = 600 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.hashclient_retry_attempts = 2 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.memcache_dead_retry = 300 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.memcache_pool_maxsize = 10 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.memcache_sasl_enabled = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.password = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.proxies = [] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.redis_db = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.redis_server = localhost:6379 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.retry_attempts = 2 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.retry_delay = 0.0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.socket_keepalive_count = 1 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.socket_keepalive_idle = 1 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.socket_keepalive_interval = 1 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.socket_timeout = 1.0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.tls_allowed_ciphers = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.tls_cafile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.tls_certfile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.tls_enabled = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.tls_keyfile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cache.username = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] coordination.backend_url = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.asyncio_connection = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.asyncio_slave_connection = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.backend = sqlalchemy {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.connection = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.connection_debug = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.connection_parameters = {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.connection_recycle_time = 3600 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.connection_trace = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.db_inc_retry_interval = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.db_max_retries = 20 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.db_max_retry_interval = 10 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.db_retry_interval = 1 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.max_overflow = 50 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.max_pool_size = 5 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.max_retries = 10 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.mysql_wsrep_sync_wait = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.pool_timeout = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.retry_interval = 10 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.slave_connection = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.sqlite_synchronous = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.synchronous_reader = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] database.use_db_reconnect = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_tracing.insecure = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] profiler.connection_string = messaging:// {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] profiler.enabled = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] profiler.es_doc_type = notification {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] profiler.es_scroll_size = 10000 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] profiler.es_scroll_time = 2m {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] profiler.filter_error_trace = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] profiler.hmac_keys = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] profiler.sentinel_service_name = mymaster {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] profiler.socket_timeout = 0.1 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] profiler.trace_requests = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] profiler.trace_sqlalchemy = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] profiler_jaeger.process_tags = {} {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] profiler_jaeger.service_name_prefix = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] profiler_otlp.service_name_prefix = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_policy.enforce_new_defaults = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_policy.policy_default_rule = default {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_policy.policy_file = policy.yaml {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] privsep_osbrick.group = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] privsep_osbrick.helper_command = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] privsep_osbrick.user = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cinder_sys_admin.group = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cinder_sys_admin.helper_command = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] cinder_sys_admin.user = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] service_user.auth_section = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] service_user.auth_type = password {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] service_user.cafile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] service_user.certfile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] service_user.collect_timing = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] service_user.insecure = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] service_user.keyfile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] service_user.send_service_user_token = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] service_user.split_loggers = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] service_user.timeout = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] service_user.tls_ciphers = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] service_user.tls_min_version = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance.auth_section = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance.auth_type = password {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance.certfile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance.collect_timing = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance.insecure = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance.keyfile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance.region_name = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance.split_loggers = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance.timeout = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance.tls_ciphers = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] glance.tls_min_version = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.backend_availability_zone = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.chap_password = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.chap_username = {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.disk_geometry = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.driver_client_cert = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.driver_client_cert_key = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.driver_data_namespace = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.driver_use_ssl = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.extra_capabilities = {} {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.filter_function = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.goodness_function = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.iscsi_target_flags = {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.iscsi_write_cache = on {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.iser_helper = tgtadm {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.iser_ip_address = 192.168.122.40 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.iser_port = 3260 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.nas_host = {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.nas_login = admin {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.nas_mount_options = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.nas_password = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.nas_private_key = {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.nas_share_path = {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.num_shell_tries = 3 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85481]: DEBUG cinder.volume.drivers.quobyte [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85481) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85481]: WARNING cinder.volume.drivers.quobyte [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85481]: WARNING cinder.volume.drivers.quobyte [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.quobyte_volume_url = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85481]: DEBUG oslo_concurrency.processutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Running cmd (subprocess): mount.quobyte {{(pid=85481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.replication_device = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.report_discard_supported = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.reserved_percentage = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.target_helper = tgtadm {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.target_ip_address = 192.168.122.40 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.target_port = 3260 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.target_protocol = iscsi {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.trace_flags = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.unique_fqdn_network = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.use_chap_auth = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.volume_backend_name = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.volume_clear = zero {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.volume_clear_ionice = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.volume_clear_size = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_reports.file_event_handler = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_reports.log_dir = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.backend_availability_zone = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.backend_host = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.chap_password = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.chap_username = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.chiscsi_conf = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.disk_geometry = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.driver_client_cert = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.driver_data_namespace = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.driver_use_ssl = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.extra_capabilities = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.filter_function = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.goodness_function = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.iser_helper = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.iser_ip_address = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.iser_port = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.iser_target_prefix = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.nas_host = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.nas_login = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.nas_mount_options = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.nas_password = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.nas_private_key = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.nas_share_path = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.nas_ssh_port = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.num_shell_tries = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.nvmet_port_id = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.replication_device = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.report_discard_supported = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.reserved_percentage = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.scst_target_driver = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.storage_protocol = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.target_helper = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.target_ip_address = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.target_port = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.target_prefix = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.target_protocol = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.trace_flags = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.use_chap_auth = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.volume_clear = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.volume_clear_size = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] QuobyteHD.volumes_dir = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.ssl = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_notifications.driver = [] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_notifications.retry = -1 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] key_manager.fixed_key = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.barbican_api_version = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.barbican_endpoint = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.barbican_endpoint_type = public {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.barbican_region_name = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.cafile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.certfile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.collect_timing = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.insecure = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.keyfile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.number_of_retries = 60 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.retry_delay = 1 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.send_service_user_token = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.split_loggers = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.timeout = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.tls_ciphers = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.tls_min_version = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.verify_ssl = True {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican.verify_ssl_path = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican_service_user.auth_section = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican_service_user.auth_type = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican_service_user.cafile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican_service_user.certfile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican_service_user.collect_timing = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican_service_user.insecure = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican_service_user.keyfile = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican_service_user.split_loggers = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican_service_user.timeout = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican_service_user.tls_ciphers = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] barbican_service_user.tls_min_version = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] vault.approle_role_id = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] vault.approle_secret_id = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] vault.auth_method = approle {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] vault.auth_path = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] vault.kv_mountpoint = secret {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] vault.kv_path = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] vault.kv_version = 2 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] vault.namespace = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] vault.root_token_id = **** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] vault.ssl_ca_crt_file = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] vault.timeout = 60.0 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] vault.token_file = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] vault.token_role = None {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] vault.use_ssl = False {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:30 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] ******************************************************************************** {{(pid=85266) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 17 14:55:30 devstack quobyte-client[85482]: Reading configuration file: /etc/quobyte/client.cfg Sep 17 14:55:30 devstack quobyte-client[85482]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 17 14:55:30 devstack cinder-volume[85481]: DEBUG oslo_concurrency.processutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] CMD "mount.quobyte" returned: 1 in 0.169s {{(pid=85481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:55:30 devstack cinder-volume[85481]: DEBUG oslo_concurrency.lockutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:55:30 devstack cinder-volume[85481]: DEBUG oslo_concurrency.lockutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:55:30 devstack cinder-volume[85481]: DEBUG cinder.volume.drivers.quobyte [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=85481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:55:30 devstack cinder-volume[85481]: INFO cinder.volume.drivers.quobyte [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 ... Sep 17 14:55:30 devstack cinder-volume[85481]: DEBUG oslo_concurrency.processutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d -c /etc/quobyte/client-cinder.cfg {{(pid=85481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:55:30 devstack sudo[85487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d -c /etc/quobyte/client-cinder.cfg Sep 17 14:55:30 devstack sudo[85487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:55:30 devstack sudo[85487]: pam_unix(sudo:session): session closed for user root Sep 17 14:55:30 devstack cinder-volume[85481]: DEBUG oslo_concurrency.processutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.399s {{(pid=85481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:55:30 devstack cinder-volume[85481]: INFO cinder.volume.drivers.quobyte [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 succeeded Sep 17 14:55:30 devstack cinder-volume[85481]: DEBUG cinder.volume.drivers.quobyte [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=85481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:55:30 devstack cinder-volume[85481]: DEBUG oslo_concurrency.lockutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.431s {{(pid=85481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:55:30 devstack cinder-volume[85481]: DEBUG oslo_concurrency.processutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=85481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:55:30 devstack sudo[85586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:55:30 devstack sudo[85586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:55:31 devstack sudo[85586]: pam_unix(sudo:session): session closed for user root Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG oslo_concurrency.processutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.237s {{(pid=85481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:55:31 devstack cinder-volume[85481]: INFO cinder.volume.driver [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Driver hasn't implemented _init_vendor_properties() Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG cinder.volume.driver [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8068466186523, 'free_capacity_gb': 1775.8068466186523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85481) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG oslo_db.sqlalchemy.engines [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85481) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG dbcounter [-] [85481] Writer thread running {{(pid=85481) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG cinder.db.api [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Building query based on filter {{(pid=85481) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG cinder.image.image_utils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85481) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 17 14:55:31 devstack cinder-volume[85481]: INFO cinder.keymgr.migration [None req-2b5354ef-3190-40f7-96d2-d32a504c3cbd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG oslo_concurrency.lockutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG oslo_concurrency.lockutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG cinder.volume.drivers.quobyte [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=85481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG cinder.volume.drivers.quobyte [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=85481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG oslo_concurrency.lockutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG oslo_concurrency.processutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=85481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:55:31 devstack sudo[85589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:55:31 devstack sudo[85589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:55:31 devstack sudo[85589]: pam_unix(sudo:session): session closed for user root Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG oslo_concurrency.processutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.230s {{(pid=85481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG cinder.manager [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Notifying Schedulers of capabilities ... {{(pid=85481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:55:31 devstack cinder-volume[85481]: INFO cinder.volume.manager [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Driver initialization completed successfully. Sep 17 14:55:31 devstack cinder-volume[85481]: INFO cinder.manager [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Initiating service 3 cleanup Sep 17 14:55:31 devstack cinder-volume[85481]: INFO cinder.manager [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Service 3 cleanup completed. Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG cinder.service [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Creating RPC server for service cinder-volume {{(pid=85481) start /opt/stack/cinder/cinder/service.py:231}} Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG cinder.service [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85481) start /opt/stack/cinder/cinder/service.py:237}} Sep 17 14:55:31 devstack cinder-volume[85481]: INFO cinder.volume.manager [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG oslo_concurrency.lockutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG oslo_concurrency.lockutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG cinder.volume.drivers.quobyte [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=85481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG cinder.volume.drivers.quobyte [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=85481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG oslo_concurrency.lockutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG oslo_concurrency.processutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=85481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:55:31 devstack sudo[85592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:55:31 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:55:31 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root Sep 17 14:55:31 devstack cinder-volume[85481]: DEBUG oslo_concurrency.processutils [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.242s {{(pid=85481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:55:31 devstack cinder-volume[85481]: INFO cinder.volume.manager [None req-de815b78-1d1c-4938-9c45-5fa7c0474b1b None None] Driver post RPC initialization completed successfully. Sep 17 14:55:36 devstack cinder-volume[85481]: DEBUG oslo_concurrency.lockutils [None req-81e8e423-6989-49d7-80eb-78f5944bd303 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:55:36 devstack cinder-volume[85481]: DEBUG oslo_concurrency.lockutils [None req-81e8e423-6989-49d7-80eb-78f5944bd303 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:55:36 devstack cinder-volume[85481]: DEBUG cinder.volume.drivers.quobyte [None req-81e8e423-6989-49d7-80eb-78f5944bd303 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=85481) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:55:36 devstack cinder-volume[85481]: DEBUG cinder.volume.drivers.quobyte [None req-81e8e423-6989-49d7-80eb-78f5944bd303 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=85481) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:55:36 devstack cinder-volume[85481]: DEBUG oslo_concurrency.lockutils [None req-81e8e423-6989-49d7-80eb-78f5944bd303 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85481) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:55:36 devstack cinder-volume[85481]: DEBUG oslo_concurrency.processutils [None req-81e8e423-6989-49d7-80eb-78f5944bd303 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=85481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:55:36 devstack sudo[85738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:55:36 devstack sudo[85738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:55:36 devstack sudo[85738]: pam_unix(sudo:session): session closed for user root Sep 17 14:55:36 devstack cinder-volume[85481]: DEBUG oslo_concurrency.processutils [None req-81e8e423-6989-49d7-80eb-78f5944bd303 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.244s {{(pid=85481) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:55:36 devstack cinder-volume[85481]: DEBUG cinder.manager [None req-81e8e423-6989-49d7-80eb-78f5944bd303 None None] Notifying Schedulers of capabilities ... {{(pid=85481) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:55:37 devstack cinder-volume[85266]: INFO oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Caught SIGTERM, stopping children Sep 17 14:55:37 devstack cinder-volume[85266]: DEBUG oslo_concurrency.lockutils [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Acquiring lock "singleton_lock" {{(pid=85266) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 14:55:37 devstack cinder-volume[85266]: DEBUG oslo_concurrency.lockutils [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Acquired lock "singleton_lock" {{(pid=85266) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 14:55:37 devstack cinder-volume[85266]: DEBUG oslo_concurrency.lockutils [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Releasing lock "singleton_lock" {{(pid=85266) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 14:55:37 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Stop services. {{(pid=85266) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 17 14:55:37 devstack cinder-volume[85266]: DEBUG oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Killing children. {{(pid=85266) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 17 14:55:37 devstack cinder-volume[85266]: INFO oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Waiting on 1 children to exit Sep 17 14:55:39 devstack cinder-volume[85481]: DEBUG oslo_concurrency.lockutils [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Acquiring lock "singleton_lock" {{(pid=85481) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 14:55:39 devstack cinder-volume[85481]: DEBUG oslo_concurrency.lockutils [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Acquired lock "singleton_lock" {{(pid=85481) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 14:55:39 devstack cinder-volume[85481]: DEBUG oslo_concurrency.lockutils [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Releasing lock "singleton_lock" {{(pid=85481) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 14:55:39 devstack cinder-volume[85481]: WARNING amqp [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 14:55:39 devstack cinder-volume[85481]: WARNING amqp [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 14:55:40 devstack cinder-volume[85266]: INFO oslo_service.backend._eventlet.service [None req-fc225a66-225b-4363-9d24-c1b75f683574 None None] Child 85481 exited with status 0 Sep 17 14:55:40 devstack cinder-volume[85791]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 17 14:55:40 devstack cinder-volume[85791]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 14:55:40 devstack cinder-volume[85791]: we strongly recommend against using it for new projects. Sep 17 14:55:40 devstack cinder-volume[85791]: If you are already using Eventlet, we recommend migrating to a different Sep 17 14:55:40 devstack cinder-volume[85791]: framework. For more detail see Sep 17 14:55:40 devstack cinder-volume[85791]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 14:55:40 devstack cinder-volume[85791]: import eventlet # noqa Sep 17 14:55:43 devstack cinder-volume[85791]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85791) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 14:55:43 devstack cinder-volume[85791]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85791) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 14:55:43 devstack cinder-volume[85791]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85791) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 14:55:44 devstack cinder-volume[85791]: INFO dbcounter [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] Registered counter for database cinder Sep 17 14:55:44 devstack cinder-volume[85791]: DEBUG oslo_db.sqlalchemy.engines [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85791) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:55:44 devstack cinder-volume[85791]: DEBUG dbcounter [-] [85791] Writer thread running {{(pid=85791) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 14:55:44 devstack cinder-volume[85791]: INFO cinder.rpc [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 14:55:44 devstack cinder-volume[85791]: INFO cinder.rpc [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 14:55:44 devstack cinder-volume[85791]: DEBUG oslo_db.sqlalchemy.engines [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85791) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:55:44 devstack cinder-volume[85791]: INFO cinder.volume.manager [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] Determined volume DB was empty at startup. Sep 17 14:55:44 devstack cinder-volume[85791]: DEBUG cinder.volume.manager [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85791) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 17 14:55:44 devstack cinder-volume[85791]: WARNING stevedore.named [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 14:55:44 devstack cinder-volume[85791]: WARNING castellan.key_manager [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 14:55:44 devstack cinder-volume[85791]: WARNING cinder.keymgr.conf_key_mgr [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 14:55:44 devstack cinder-volume[85791]: INFO cinder.volume.manager [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 17 14:55:44 devstack cinder-volume[85791]: DEBUG oslo_db.sqlalchemy.engines [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85791) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:55:45 devstack cinder-volume[85791]: INFO oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] Starting 1 workers Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] Started child 86082 {{(pid=85791) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] Full set of CONF: {{(pid=85791) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] ******************************************************************************** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] Configuration options gathered from: {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 17 14:55:45 devstack cinder-volume[86082]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] ================================================================================ {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] allow_availability_zone_fallback = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] allow_compression_on_image_upload = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] allowed_direct_url_schemes = [] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] api_rate_limit = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] auth_strategy = keystone {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_availability_zone = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_host = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_name = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_stats_polling_interval = 60 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backup_api_class = cinder.backup.api.API {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backup_name_template = backup-%s {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backup_use_same_host = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backup_use_temp_snapshot = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] chap_password = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] chap_username = {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cinder_internal_tenant_project_id = 4b0b9e82161a43968d854c93fe133b58 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cinder_internal_tenant_user_id = dc1fc07d8cb242e98ac6afb8a3d16bfe {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cluster = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] compression_format = gzip {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] compute_api_class = cinder.compute.nova.API {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] config_dir = [] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] config_source = [] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] control_exchange = openstack {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] debug = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] default_availability_zone = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] default_group_type = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] default_volume_type = QuobyteHD {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] disk_geometry = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] driver_client_cert = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] driver_client_cert_key = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] driver_data_namespace = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] driver_ssl_cert_path = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] driver_ssl_cert_verify = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] driver_use_ssl = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] enable_new_services = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] enable_unsupported_driver = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] enabled_backends = ['QuobyteHD'] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] enforce_multipath_for_image_xfer = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] filter_function = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance_api_insecure = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance_api_servers = ['http://192.168.122.40/image'] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance_api_ssl_compression = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance_ca_certificates_file = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance_catalog_info = image:glance:publicURL {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance_certfile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance_keyfile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance_num_retries = 3 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance_request_timeout = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] goodness_function = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] graceful_shutdown_timeout = 5 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] group_api_class = cinder.group.api.API {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] host = devstack {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86082) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] image_compress_on_upload = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] image_conversion_address_space_limit = 1 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] image_conversion_cpu_limit = 60 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] image_conversion_disable = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] image_introspection_address_space_limit = 1 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] image_introspection_cpu_limit = 60 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] image_upload_use_cinder_backend = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] image_upload_use_internal_tenant = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] image_volume_cache_enabled = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] image_volume_cache_max_count = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] image_volume_cache_max_size_gb = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] init_host_max_objects_retrieval = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] instance_format = [instance: %(uuid)s] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] iscsi_target_flags = {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] iscsi_write_cache = on {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] iser_helper = tgtadm {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] iser_ip_address = 192.168.122.40 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] iser_port = 3260 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] log_color = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] log_config_append = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] log_dir = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] log_file = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] log_options = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] log_rotate_interval = 1 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] log_rotate_interval_type = days {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] log_rotation_type = none {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] max_age = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] max_logfile_count = 30 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] max_logfile_size_mb = 200 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] max_over_subscription_ratio = 20.0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] message_reap_interval = 86400 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] message_ttl = 2592000 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] migration_create_volume_timeout_secs = 300 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] monkey_patch = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] monkey_patch_modules = [] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] my_ip = 192.168.122.40 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] no_snapshot_gb_quota = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] num_iser_scan_tries = 3 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] num_shell_tries = 3 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] num_volume_device_scan_tries = 3 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] nvmeof_conn_info_version = 1 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] nvmet_ns_id = 10 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] nvmet_port_id = 1 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] osapi_max_limit = 1000 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] osapi_volume_ext_list = [] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] osapi_volume_listen = 0.0.0.0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] osapi_volume_listen_port = 8776 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] osapi_volume_use_ssl = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] osapi_volume_workers = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] per_volume_size_limit = -1 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] periodic_fuzzy_delay = 60 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] periodic_interval = 60 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] project_id_regex = [0-9a-f\-]+ {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] public_endpoint = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] publish_errors = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] quota_backup_gigabytes = 1000 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] quota_backups = 10 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] quota_gigabytes = 1000 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] quota_groups = 10 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] quota_snapshots = 10 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] quota_volumes = 10 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] rate_limit_burst = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] rate_limit_except_level = CRITICAL {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] rate_limit_interval = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] reinit_driver_count = 3 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] replication_device = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] report_discard_supported = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] report_interval = 120 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] reservation_clean_interval = 86400 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] reservation_expire = 86400 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] reserved_image_namespaces = [] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] reserved_percentage = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] rpc_response_timeout = 120 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] run_external_periodic_tasks = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] scst_target_driver = iscsi {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] scst_target_iqn_name = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] service_down_time = 720 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] shell_completion = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] snapshot_name_template = snapshot-%s {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] split_loggers = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] state_path = /opt/stack/data/cinder {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] storage_availability_zone = nova {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] storage_protocol = iSCSI {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] syslog_log_facility = LOG_USER {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] target_helper = lioadm {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] target_ip_address = 192.168.122.40 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] target_port = 3260 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] target_protocol = iscsi {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] target_secondary_ip_addresses = [] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] trace_flags = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] transfer_api_class = cinder.transfer.api.API {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] transport_url = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] until_refresh = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] use_chap_auth = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] use_default_quota_class = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] use_journal = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] use_json = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] use_multipath_for_image_xfer = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86082) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 17 14:55:45 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.quobyte [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 17 14:55:45 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.quobyte [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] use_stderr = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] use_syslog = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] verify_glance_signatures = enabled {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Running cmd (subprocess): mount.quobyte {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] volume_api_class = cinder.volume.api.API {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] volume_backend_name = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] volume_clear = zero {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] volume_clear_ionice = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] volume_clear_size = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] volume_copy_bps_limit = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] volume_dd_blocksize = 1M {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] volume_name_template = volume-%s {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] volume_service_inithost_offload = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] volume_usage_audit_period = month {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] zoning_mode = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_concurrency.disable_process_locking = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.auth_section = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.auth_type = password {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.auth_version = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.cache = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.certfile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.delay_auth_decision = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.http_connect_timeout = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.include_service_catalog = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.insecure = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.interface = public {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.keyfile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.memcache_password = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.memcache_username = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.region_name = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.service_token_roles_required = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.service_type = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.token_cache_time = 300 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.40/identity {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.backend = dogpile.cache.null {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.backend_argument = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.backend_expiration_time = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.config_prefix = cache.oslo {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.debug_cache_backend = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.enable_retry_client = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.enable_socket_keepalive = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.enabled = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.expiration_time = 600 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.hashclient_retry_attempts = 2 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.memcache_dead_retry = 300 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.memcache_pool_maxsize = 10 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.memcache_sasl_enabled = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.password = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.proxies = [] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.redis_db = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.redis_sentinel_service_name = mymaster {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.redis_server = localhost:6379 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.retry_attempts = 2 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.retry_delay = 0.0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.socket_keepalive_count = 1 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.socket_keepalive_idle = 1 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.socket_keepalive_interval = 1 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.socket_timeout = 1.0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.tls_allowed_ciphers = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.tls_cafile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.tls_certfile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.tls_enabled = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.tls_keyfile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cache.username = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] coordination.backend_url = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.asyncio_connection = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.asyncio_slave_connection = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.backend = sqlalchemy {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.connection = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.connection_debug = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.connection_parameters = {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.connection_recycle_time = 3600 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.connection_trace = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.db_inc_retry_interval = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.db_max_retries = 20 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.db_max_retry_interval = 10 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.db_retry_interval = 1 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.max_overflow = 50 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.max_pool_size = 5 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.max_retries = 10 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.mysql_wsrep_sync_wait = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.pool_timeout = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.retry_interval = 10 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.slave_connection = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.sqlite_synchronous = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.synchronous_reader = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] database.use_db_reconnect = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_tracing.insecure = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack quobyte-client[86085]: Reading configuration file: /etc/quobyte/client.cfg Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] profiler.connection_string = messaging:// {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] profiler.enabled = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] profiler.es_doc_type = notification {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] profiler.es_scroll_size = 10000 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] profiler.es_scroll_time = 2m {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack quobyte-client[86085]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] profiler.filter_error_trace = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] profiler.hmac_keys = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] profiler.sentinel_service_name = mymaster {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] profiler.socket_timeout = 0.1 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] profiler.trace_requests = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] profiler.trace_sqlalchemy = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] profiler_jaeger.process_tags = {} {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] profiler_jaeger.service_name_prefix = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] profiler_otlp.service_name_prefix = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_policy.enforce_new_defaults = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_policy.policy_default_rule = default {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] CMD "mount.quobyte" returned: 1 in 0.119s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_policy.policy_file = policy.yaml {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_policy.remote_timeout = 60.0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] privsep_osbrick.group = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] privsep_osbrick.helper_command = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] privsep_osbrick.user = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cinder_sys_admin.group = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cinder_sys_admin.helper_command = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] cinder_sys_admin.user = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] service_user.auth_section = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] service_user.auth_type = password {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] service_user.cafile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] service_user.certfile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] service_user.collect_timing = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] service_user.insecure = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] service_user.keyfile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] service_user.send_service_user_token = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] service_user.split_loggers = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] service_user.timeout = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] service_user.tls_ciphers = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] service_user.tls_min_version = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance.auth_section = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance.auth_type = password {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance.certfile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance.collect_timing = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance.insecure = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance.keyfile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance.region_name = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance.split_loggers = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance.timeout = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance.tls_ciphers = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] glance.tls_min_version = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.backend_availability_zone = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.chap_password = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.chap_username = {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.disk_geometry = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.driver_client_cert = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.driver_client_cert_key = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.driver_data_namespace = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.driver_use_ssl = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.enable_unsupported_driver = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.extra_capabilities = {} {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.filter_function = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.goodness_function = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.iscsi_target_flags = {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.iscsi_write_cache = on {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.iser_helper = tgtadm {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.iser_ip_address = 192.168.122.40 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.iser_port = 3260 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.nas_host = {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.nas_login = admin {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.nas_mount_options = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.nas_password = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.nas_private_key = {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.nas_share_path = {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.nas_ssh_port = 22 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.num_shell_tries = 3 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.nvmet_port_id = 1 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.quobyte_client_cfg = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.quobyte_volume_url = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.replication_device = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.report_discard_supported = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.reserved_percentage = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.scst_target_driver = iscsi {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.scst_target_iqn_name = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.storage_protocol = iSCSI {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.target_helper = tgtadm {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.target_ip_address = 192.168.122.40 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.target_port = 3260 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.target_protocol = iscsi {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.trace_flags = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.unique_fqdn_network = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.use_chap_auth = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.volume_backend_name = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack sudo[86092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.volume_clear = zero {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.volume_clear_ionice = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.volume_clear_size = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack sudo[86092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_reports.file_event_handler = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_reports.log_dir = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.backend_availability_zone = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.backend_host = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.chap_password = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.chap_username = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.chiscsi_conf = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.disk_geometry = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.driver_client_cert = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.driver_client_cert_key = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.driver_data_namespace = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.driver_use_ssl = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.extra_capabilities = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.filter_function = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.goodness_function = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.iscsi_target_flags = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.iscsi_write_cache = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.iser_helper = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.iser_ip_address = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.iser_port = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.iser_target_prefix = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.nas_host = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.nas_login = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.nas_mount_options = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.nas_password = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.nas_private_key = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.nas_share_path = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.nas_ssh_port = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.num_shell_tries = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.nvmet_ns_id = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.nvmet_port_id = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.replication_device = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.report_discard_supported = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.reserved_percentage = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.scst_target_driver = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.storage_protocol = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.target_helper = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.target_ip_address = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.target_port = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.target_prefix = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.target_protocol = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.trace_flags = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.unique_fqdn_network = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.use_chap_auth = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.volume_clear = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.volume_clear_ionice = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.volume_clear_size = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] QuobyteHD.volumes_dir = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.ssl = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.ssl_version = {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_notifications.driver = [] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_notifications.retry = -1 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] oslo_messaging_notifications.transport_url = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] key_manager.fixed_key = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.barbican_api_version = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.barbican_endpoint = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.barbican_endpoint_type = public {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.barbican_region_name = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.cafile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.certfile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.collect_timing = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.insecure = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.keyfile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.number_of_retries = 60 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.retry_delay = 1 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.send_service_user_token = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.split_loggers = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.timeout = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.tls_ciphers = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.tls_min_version = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.verify_ssl = True {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican.verify_ssl_path = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican_service_user.auth_section = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican_service_user.auth_type = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican_service_user.cafile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican_service_user.certfile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican_service_user.collect_timing = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican_service_user.insecure = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican_service_user.keyfile = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican_service_user.split_loggers = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican_service_user.timeout = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican_service_user.tls_ciphers = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] barbican_service_user.tls_min_version = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] vault.approle_role_id = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] vault.approle_secret_id = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] vault.auth_method = approle {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] vault.auth_path = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] vault.kv_mountpoint = secret {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] vault.kv_path = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] vault.kv_version = 2 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] vault.namespace = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] vault.root_token_id = **** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] vault.ssl_ca_crt_file = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] vault.timeout = 60.0 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] vault.token_file = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] vault.token_role = None {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] vault.use_ssl = False {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:45 devstack cinder-volume[85791]: DEBUG oslo_service.backend._eventlet.service [None req-dd588add-a7a1-4e32-a9fc-a98d281e76ea None None] ******************************************************************************** {{(pid=85791) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 17 14:55:45 devstack sudo[86092]: pam_unix(sudo:session): session closed for user root Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.305s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:55:45 devstack cinder-volume[86082]: INFO cinder.volume.driver [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Driver hasn't implemented _init_vendor_properties() Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG cinder.volume.driver [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8068466186523, 'free_capacity_gb': 1775.8068466186523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86082) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG oslo_db.sqlalchemy.engines [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86082) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writer thread running {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG cinder.db.api [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Building query based on filter {{(pid=86082) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86082) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:55:45 devstack cinder-volume[86082]: INFO cinder.keymgr.migration [None req-b3cf614d-607e-4f54-9bec-589908fd07bb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 14:55:45 devstack sudo[86103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:55:45 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:55:45 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.233s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:55:45 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:55:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Driver initialization completed successfully. Sep 17 14:55:45 devstack cinder-volume[86082]: INFO cinder.manager [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Initiating service 3 cleanup Sep 17 14:55:46 devstack cinder-volume[86082]: INFO cinder.manager [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Service 3 cleanup completed. Sep 17 14:55:46 devstack cinder-volume[86082]: DEBUG cinder.service [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Creating RPC server for service cinder-volume {{(pid=86082) start /opt/stack/cinder/cinder/service.py:231}} Sep 17 14:55:46 devstack cinder-volume[86082]: DEBUG cinder.service [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86082) start /opt/stack/cinder/cinder/service.py:237}} Sep 17 14:55:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 17 14:55:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:55:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:55:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:55:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:55:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:55:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:55:46 devstack sudo[86110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:55:46 devstack sudo[86110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:55:46 devstack sudo[86110]: pam_unix(sudo:session): session closed for user root Sep 17 14:55:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.246s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:55:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b1987865-7987-4bfb-af0f-b56463d63b98 None None] Driver post RPC initialization completed successfully. Sep 17 14:55:55 devstack cinder-volume[85791]: DEBUG dbcounter [-] [85791] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85791) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:55:56 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=3 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:55:56 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:56:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:56:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 6 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 14:56:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Flow 'volume_create_manager' (b726ec43-b540-4b1d-b1cc-64cd1c32627f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c919cce-48fc-474d-a5eb-362d95b83459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c919cce-48fc-474d-a5eb-362d95b83459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-238557344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db478ce3-f5dd-428a-b18e-3b0049840ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5340a52f09e346ebb7545d9353b50022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:57:01Z,use_quota=True,user_id='bc8134ea6de04bf8aac4f2cc9347d89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6f88b1-a725-4f0c-9d10-8d28b8389211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6f88b1-a725-4f0c-9d10-8d28b8389211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d35e55-27c2-45be-baa0-346f09e1059b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d35e55-27c2-45be-baa0-346f09e1059b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db478ce3-f5dd-428a-b18e-3b0049840ebb', 'volume_name': 'volume-db478ce3-f5dd-428a-b18e-3b0049840ebb', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd4c69b-aaec-4a68-b799-f6b8687efb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd4c69b-aaec-4a68-b799-f6b8687efb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16fca10e-0f35-4df9-b934-7419c7df2316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:01 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Volume db478ce3-f5dd-428a-b18e-3b0049840ebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db478ce3-f5dd-428a-b18e-3b0049840ebb', 'volume_size': 1} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-238557344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db478ce3-f5dd-428a-b18e-3b0049840ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5340a52f09e346ebb7545d9353b50022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:57:01Z,use_quota=True,user_id='bc8134ea6de04bf8aac4f2cc9347d89f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Creating volume db478ce3-f5dd-428a-b18e-3b0049840ebb {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:57:01 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 14:57:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-db478ce3-f5dd-428a-b18e-3b0049840ebb 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:01 devstack sudo[86907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-db478ce3-f5dd-428a-b18e-3b0049840ebb 1073741824 Sep 17 14:57:01 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:03 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-db478ce3-f5dd-428a-b18e-3b0049840ebb 1073741824" returned: 0 in 1.693s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-db478ce3-f5dd-428a-b18e-3b0049840ebb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:03 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-db478ce3-f5dd-428a-b18e-3b0049840ebb Sep 17 14:57:03 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:04 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-db478ce3-f5dd-428a-b18e-3b0049840ebb" returned: 0 in 0.702s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] <== create_volume: return (2538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:57:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.542s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16fca10e-0f35-4df9-b934-7419c7df2316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db478ce3-f5dd-428a-b18e-3b0049840ebb', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980b2985-e018-4307-bce6-bf4335588482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:04 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Volume volume-db478ce3-f5dd-428a-b18e-3b0049840ebb (db478ce3-f5dd-428a-b18e-3b0049840ebb): created successfully Sep 17 14:57:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980b2985-e018-4307-bce6-bf4335588482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Flow 'volume_create_manager' (b726ec43-b540-4b1d-b1cc-64cd1c32627f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:57:04 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4f26bd44-423d-453a-8aac-077a28eb1537 tempest-DeleteServersTestJSON-1140177204 None] Created volume successfully. Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Flow 'volume_create_manager' (b2432edf-c0a7-4ba6-a600-86c6bcdef8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e8cb49-87ae-4fd4-87a4-131e0cb0edda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e8cb49-87ae-4fd4-87a4-131e0cb0edda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-776272382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6b704e-5a9d-41e0-8cc2-b5a9363b1465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d10ca35aa04c5783c1014e66132224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:57:07Z,use_quota=True,user_id='f8450bee0e444dae9014e5d1d43fe1e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7288065c-6888-4079-9d39-bcf81f919fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7288065c-6888-4079-9d39-bcf81f919fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb605259-bee9-438a-950e-eafda72f7a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb605259-bee9-438a-950e-eafda72f7a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df6b704e-5a9d-41e0-8cc2-b5a9363b1465', 'volume_name': 'volume-df6b704e-5a9d-41e0-8cc2-b5a9363b1465', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50105157-0dfc-41f1-95df-f755f2cd28f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50105157-0dfc-41f1-95df-f755f2cd28f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783cead8-a17b-40de-bcdc-b1cd4a1a8100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:07 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Volume df6b704e-5a9d-41e0-8cc2-b5a9363b1465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df6b704e-5a9d-41e0-8cc2-b5a9363b1465', 'volume_size': 1} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-776272382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6b704e-5a9d-41e0-8cc2-b5a9363b1465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d10ca35aa04c5783c1014e66132224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:57:07Z,use_quota=True,user_id='f8450bee0e444dae9014e5d1d43fe1e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Creating volume df6b704e-5a9d-41e0-8cc2-b5a9363b1465 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:57:07 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 14:57:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-df6b704e-5a9d-41e0-8cc2-b5a9363b1465 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:07 devstack sudo[87263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-df6b704e-5a9d-41e0-8cc2-b5a9363b1465 1073741824 Sep 17 14:57:07 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:08 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-df6b704e-5a9d-41e0-8cc2-b5a9363b1465 1073741824" returned: 0 in 1.075s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-df6b704e-5a9d-41e0-8cc2-b5a9363b1465 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:08 devstack sudo[87276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-df6b704e-5a9d-41e0-8cc2-b5a9363b1465 Sep 17 14:57:08 devstack sudo[87276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:09 devstack sudo[87276]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-df6b704e-5a9d-41e0-8cc2-b5a9363b1465" returned: 0 in 0.838s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:57:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783cead8-a17b-40de-bcdc-b1cd4a1a8100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df6b704e-5a9d-41e0-8cc2-b5a9363b1465', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f106583-db34-4b41-adba-2f900d233844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:09 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Volume volume-df6b704e-5a9d-41e0-8cc2-b5a9363b1465 (df6b704e-5a9d-41e0-8cc2-b5a9363b1465): created successfully Sep 17 14:57:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f106583-db34-4b41-adba-2f900d233844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Flow 'volume_create_manager' (b2432edf-c0a7-4ba6-a600-86c6bcdef8d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:57:09 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f43a28ae-a23d-43ed-b73b-95eb4635df5d tempest-VolumesAdminNegativeTest-1958374582 None] Created volume successfully. Sep 17 14:57:09 devstack cinder-volume[86082]: WARNING py.warnings [req-17850205-5b11-48c7-923c-b16b63ae48ad req-f1bc1d2f-d697-4510-8012-be804c0da57f tempest-DeleteServersTestJSON-1140177204 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 17 14:57:09 devstack cinder-volume[86082]: .first() Sep 17 14:57:09 devstack cinder-volume[86082]: Sep 17 14:57:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-17850205-5b11-48c7-923c-b16b63ae48ad req-f1bc1d2f-d697-4510-8012-be804c0da57f tempest-DeleteServersTestJSON-1140177204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-17850205-5b11-48c7-923c-b16b63ae48ad req-f1bc1d2f-d697-4510-8012-be804c0da57f tempest-DeleteServersTestJSON-1140177204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-17850205-5b11-48c7-923c-b16b63ae48ad req-f1bc1d2f-d697-4510-8012-be804c0da57f tempest-DeleteServersTestJSON-1140177204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-17850205-5b11-48c7-923c-b16b63ae48ad req-f1bc1d2f-d697-4510-8012-be804c0da57f tempest-DeleteServersTestJSON-1140177204 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-db478ce3-f5dd-428a-b18e-3b0049840ebb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '762827ec-7e98-43ad-bc0b-715d7c06f626', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 14:57:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-17850205-5b11-48c7-923c-b16b63ae48ad req-f1bc1d2f-d697-4510-8012-be804c0da57f tempest-DeleteServersTestJSON-1140177204 None] attachment_update completed successfully. Sep 17 14:57:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Acquiring lock "cinder-df6b704e-5a9d-41e0-8cc2-b5a9363b1465-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:57:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Lock "cinder-df6b704e-5a9d-41e0-8cc2-b5a9363b1465-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:57:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Acquiring lock "cinder-quobyte-df6b704e-5a9d-41e0-8cc2-b5a9363b1465" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:57:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Lock "cinder-quobyte-df6b704e-5a9d-41e0-8cc2-b5a9363b1465" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:57:11 devstack cinder-volume[86082]: INFO oslo.privsep.daemon [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmplckikgxi/privsep.sock'] Sep 17 14:57:11 devstack sudo[87421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmplckikgxi/privsep.sock Sep 17 14:57:11 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:12 devstack cinder-volume[86082]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 17 14:57:12 devstack cinder-volume[86082]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 14:57:12 devstack cinder-volume[86082]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 17 14:57:12 devstack cinder-volume[86082]: WARNING oslo.privsep.daemon [-] privsep log: Sep 17 14:57:12 devstack cinder-volume[86082]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 17 14:57:12 devstack cinder-volume[86082]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 17 14:57:12 devstack cinder-volume[86082]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 14:57:12 devstack cinder-volume[86082]: WARNING oslo.privsep.daemon [-] privsep log: Sep 17 14:57:12 devstack cinder-volume[86082]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 17 14:57:12 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:12 devstack cinder-volume[86082]: INFO oslo.privsep.daemon [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Spawned new privsep daemon via rootwrap Sep 17 14:57:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Accepted privsep connection to /tmp/tmplckikgxi/privsep.sock {{(pid=86082) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 17 14:57:12 devstack cinder-volume[86082]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 17 14:57:12 devstack cinder-volume[86082]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 17 14:57:12 devstack cinder-volume[86082]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 17 14:57:12 devstack cinder-volume[86082]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87740 Sep 17 14:57:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b753fe-3181-4839-88e8-4917d5cb2e17]: (2,) {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:57:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e1c0ec-da6f-495b-9d98-52d20e3f4dac]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:57:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-df6b704e-5a9d-41e0-8cc2-b5a9363b1465 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:12 devstack sudo[87742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-df6b704e-5a9d-41e0-8cc2-b5a9363b1465 Sep 17 14:57:12 devstack sudo[87742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:13 devstack sudo[87742]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-df6b704e-5a9d-41e0-8cc2-b5a9363b1465" returned: 0 in 0.645s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-df6b704e-5a9d-41e0-8cc2-b5a9363b1465 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:13 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-df6b704e-5a9d-41e0-8cc2-b5a9363b1465 Sep 17 14:57:13 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:13 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-df6b704e-5a9d-41e0-8cc2-b5a9363b1465" returned: 0 in 0.577s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Lock "cinder-quobyte-df6b704e-5a9d-41e0-8cc2-b5a9363b1465" released by "delete_volume" :: held 2.980s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:57:14 devstack cinder-volume[86082]: WARNING cinder.quota [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:57:14 devstack cinder-volume[86082]: WARNING cinder.quota [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:57:14 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Created reservations ['d29b1211-4034-436b-be09-27556968806e', '22128b4e-7dda-40c7-aac5-92759a5d186e', '72757dce-e732-4a1f-9a30-0a9180ea9160', 'a0ab8bad-701f-4431-bcb3-2465d36147af'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:57:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:57:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:57:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:14 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:57:14 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:15 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.717s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:15 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:57:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Deleted volume successfully. Sep 17 14:57:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c2e8f3e1-bda5-4996-839f-f0472b934be0 tempest-VolumesAdminNegativeTest-1958374582 None] Lock "cinder-df6b704e-5a9d-41e0-8cc2-b5a9363b1465-delete_volume" released by "delete_volume" :: held 4.125s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:57:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-a8c669a7-2021-485f-9b21-d3b851d0945e req-0224e572-4245-462f-a123-5d9cc06c6613 tempest-DeleteServersTestJSON-1140177204 None] Terminate volume connection completed successfully. Sep 17 14:57:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-a8c669a7-2021-485f-9b21-d3b851d0945e req-0224e572-4245-462f-a123-5d9cc06c6613 tempest-DeleteServersTestJSON-1140177204 None] Deleting attachment 762827ec-7e98-43ad-bc0b-715d7c06f626. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 14:57:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] Acquiring lock "cinder-db478ce3-f5dd-428a-b18e-3b0049840ebb-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:57:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] Lock "cinder-db478ce3-f5dd-428a-b18e-3b0049840ebb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:57:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] Acquiring lock "cinder-quobyte-db478ce3-f5dd-428a-b18e-3b0049840ebb" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:57:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] Lock "cinder-quobyte-db478ce3-f5dd-428a-b18e-3b0049840ebb" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:57:16 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d61d7c-9e65-47cb-a6ea-5225c8134225]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:57:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-db478ce3-f5dd-428a-b18e-3b0049840ebb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:17 devstack sudo[87833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-db478ce3-f5dd-428a-b18e-3b0049840ebb Sep 17 14:57:17 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:17 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-db478ce3-f5dd-428a-b18e-3b0049840ebb" returned: 0 in 0.373s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-db478ce3-f5dd-428a-b18e-3b0049840ebb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:17 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-db478ce3-f5dd-428a-b18e-3b0049840ebb Sep 17 14:57:17 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:17 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-db478ce3-f5dd-428a-b18e-3b0049840ebb" returned: 0 in 0.278s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] Lock "cinder-quobyte-db478ce3-f5dd-428a-b18e-3b0049840ebb" released by "delete_volume" :: held 0.701s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:57:17 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] Created reservations ['11a52baf-42d8-4617-a1c3-c675b26c2ce3', 'f7130b6c-8106-4bae-a389-246454b7fd2b', 'd155d13e-5037-4409-b243-a70e15e1addf', 'ef96c9bb-c568-45d3-a633-66e4e805eb6b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:57:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:57:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:57:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:17 devstack sudo[87841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:57:17 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:18 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.236s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:18 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:57:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] Deleted volume successfully. Sep 17 14:57:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-71584671-ca4f-41c7-b056-01ba2359eaee tempest-DeleteServersTestJSON-1140177204 None] Lock "cinder-db478ce3-f5dd-428a-b18e-3b0049840ebb-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Flow 'volume_create_manager' (8e8ba073-bb12-4e5f-b45b-dc9bbe2c46e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfbdc8e-0f5a-4250-99c9-8282b9cb231f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfbdc8e-0f5a-4250-99c9-8282b9cb231f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1457923251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d44f1fc-260a-4c69-93a3-8c3dc885f04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d551293a1e480a8671a0bd9dc1e2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:57:26Z,use_quota=True,user_id='2df71feef87044eaac06c713cadc1257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b167b8c3-85fe-4a67-80ec-7059c7a34d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b167b8c3-85fe-4a67-80ec-7059c7a34d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abaa99a-7068-450b-abfd-dfadd400bf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abaa99a-7068-450b-abfd-dfadd400bf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d44f1fc-260a-4c69-93a3-8c3dc885f04d', 'volume_name': 'volume-9d44f1fc-260a-4c69-93a3-8c3dc885f04d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbda5916-88ac-4788-8b71-0ad741019b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbda5916-88ac-4788-8b71-0ad741019b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de32a809-6d9b-4b93-ba81-e0e1d719f0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:25 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Volume 9d44f1fc-260a-4c69-93a3-8c3dc885f04d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d44f1fc-260a-4c69-93a3-8c3dc885f04d', 'volume_size': 1} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1457923251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d44f1fc-260a-4c69-93a3-8c3dc885f04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d551293a1e480a8671a0bd9dc1e2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:57:26Z,use_quota=True,user_id='2df71feef87044eaac06c713cadc1257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Creating volume 9d44f1fc-260a-4c69-93a3-8c3dc885f04d {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:57:25 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 14:57:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9d44f1fc-260a-4c69-93a3-8c3dc885f04d 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:25 devstack sudo[87854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9d44f1fc-260a-4c69-93a3-8c3dc885f04d 1073741824 Sep 17 14:57:25 devstack sudo[87854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:26 devstack sudo[87854]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9d44f1fc-260a-4c69-93a3-8c3dc885f04d 1073741824" returned: 0 in 0.654s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9d44f1fc-260a-4c69-93a3-8c3dc885f04d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:26 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9d44f1fc-260a-4c69-93a3-8c3dc885f04d Sep 17 14:57:26 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:26 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9d44f1fc-260a-4c69-93a3-8c3dc885f04d" returned: 0 in 0.278s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:57:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de32a809-6d9b-4b93-ba81-e0e1d719f0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d44f1fc-260a-4c69-93a3-8c3dc885f04d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847971f0-967c-4392-9503-5c23fb123623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:26 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Volume volume-9d44f1fc-260a-4c69-93a3-8c3dc885f04d (9d44f1fc-260a-4c69-93a3-8c3dc885f04d): created successfully Sep 17 14:57:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847971f0-967c-4392-9503-5c23fb123623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Flow 'volume_create_manager' (8e8ba073-bb12-4e5f-b45b-dc9bbe2c46e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:57:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-70892e33-2100-436a-9e59-b277cf11d01c tempest-ServerActionsTestOtherA-1114292147 None] Created volume successfully. Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Flow 'volume_create_manager' (34b7d578-a880-4fd1-9be4-106c52fd5714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b48b6b9-1cfd-4bc9-a62a-5ab46c56f658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b48b6b9-1cfd-4bc9-a62a-5ab46c56f658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-946105380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c693c834-a13f-4f44-ba82-be79bdf6dedc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f950d19ada049959d5ea0b36d27f5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:57:31Z,use_quota=True,user_id='155fde65c12f4e54965b2b8db42cf89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c022c34-df9d-429d-a229-5ba839330615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c022c34-df9d-429d-a229-5ba839330615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b91dc15-9afd-4f8f-8b35-2122ba53a206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b91dc15-9afd-4f8f-8b35-2122ba53a206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c693c834-a13f-4f44-ba82-be79bdf6dedc', 'volume_name': 'volume-c693c834-a13f-4f44-ba82-be79bdf6dedc', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950f8f2a-9fc0-4d18-b211-a6aedc79d60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950f8f2a-9fc0-4d18-b211-a6aedc79d60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd022637-06eb-4d3f-811a-efe93b6ff839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:30 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Volume c693c834-a13f-4f44-ba82-be79bdf6dedc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c693c834-a13f-4f44-ba82-be79bdf6dedc', 'volume_size': 1} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-946105380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c693c834-a13f-4f44-ba82-be79bdf6dedc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f950d19ada049959d5ea0b36d27f5d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:57:31Z,use_quota=True,user_id='155fde65c12f4e54965b2b8db42cf89a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Creating volume c693c834-a13f-4f44-ba82-be79bdf6dedc {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:57:30 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 14:57:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:30 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc 1073741824 Sep 17 14:57:30 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:31 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc 1073741824" returned: 0 in 0.474s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:31 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc Sep 17 14:57:31 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:31 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc" returned: 0 in 0.269s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:57:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd022637-06eb-4d3f-811a-efe93b6ff839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c693c834-a13f-4f44-ba82-be79bdf6dedc', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40514cc-2618-4063-b345-3a11859be510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:31 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Volume volume-c693c834-a13f-4f44-ba82-be79bdf6dedc (c693c834-a13f-4f44-ba82-be79bdf6dedc): created successfully Sep 17 14:57:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40514cc-2618-4063-b345-3a11859be510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Flow 'volume_create_manager' (34b7d578-a880-4fd1-9be4-106c52fd5714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:57:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-6b0c0e60-c380-4ab0-bafe-f4bf5c4482dc req-96619345-185f-45a5-8b68-b12be014efc8 tempest-VolumesSnapshotsTestJSON-1045311572 None] Created volume successfully. Sep 17 14:57:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] Creating offline snapshot a860345f-4648-499c-b2c1-4a26cfc90fa2 of volume c693c834-a13f-4f44-ba82-be79bdf6dedc {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 14:57:32 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[859d830c-246e-47e4-bf55-3e9097a78c02]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:57:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:32 devstack sudo[87878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc Sep 17 14:57:32 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:32 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc" returned: 0 in 0.374s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:32 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2 1G Sep 17 14:57:32 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:33 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2 1G" returned: 0 in 0.514s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c693c834-a13f-4f44-ba82-be79bdf6dedc -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:33 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c693c834-a13f-4f44-ba82-be79bdf6dedc -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2 Sep 17 14:57:33 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:33 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c693c834-a13f-4f44-ba82-be79bdf6dedc -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2" returned: 0 in 0.367s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:33 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2 is being set with open permissions: ugo+rw Sep 17 14:57:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:33 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2 Sep 17 14:57:33 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:33 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2" returned: 0 in 0.262s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:33 devstack sudo[87897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.info Sep 17 14:57:33 devstack sudo[87897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:34 devstack sudo[87897]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.info" returned: 0 in 0.291s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:34 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.info is being set with open permissions: ugo+rw Sep 17 14:57:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:34 devstack sudo[87901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.info Sep 17 14:57:34 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:34 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.info" returned: 0 in 0.356s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.282s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:34 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-8f87507f-d4d3-4421-8b88-ab36aae74f8d req-2241ed77-d18c-4437-b47b-ae0c063dd14c tempest-VolumesSnapshotsTestJSON-1045311572 None] Create snapshot completed successfully Sep 17 14:57:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] Acquiring lock "cinder-a860345f-4648-499c-b2c1-4a26cfc90fa2-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:57:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] Lock "cinder-a860345f-4648-499c-b2c1-4a26cfc90fa2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:57:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] Acquiring lock "cinder-quobyte-c693c834-a13f-4f44-ba82-be79bdf6dedc" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:57:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] Lock "cinder-quobyte-c693c834-a13f-4f44-ba82-be79bdf6dedc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:57:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] Acquiring lock "cinder-quobyte-a860345f-4648-499c-b2c1-4a26cfc90fa2" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:57:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] Lock "cinder-quobyte-a860345f-4648-499c-b2c1-4a26cfc90fa2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:57:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] Deleting offline snapshot a860345f-4648-499c-b2c1-4a26cfc90fa2 of volume c693c834-a13f-4f44-ba82-be79bdf6dedc {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 14:57:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] snapshot_file for this snap is: volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 14:57:34 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd62f16f-d5a7-4c5f-a5f3-d3fe3a8e5f1c]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:57:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:35 devstack sudo[87909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2 Sep 17 14:57:35 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:35 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2" returned: 0 in 0.635s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c693c834-a13f-4f44-ba82-be79bdf6dedc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 14:57:35 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9450d3-f771-4dc4-809c-a5d60bc389f7]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:57:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:35 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc Sep 17 14:57:35 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:36 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc" returned: 0 in 0.583s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:36 devstack sudo[87921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2 Sep 17 14:57:36 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:36 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2" returned: 0 in 0.484s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:36 devstack sudo[87929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2 Sep 17 14:57:36 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:37 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc.a860345f-4648-499c-b2c1-4a26cfc90fa2" returned: 0 in 0.406s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] Lock "cinder-quobyte-a860345f-4648-499c-b2c1-4a26cfc90fa2" released by "_delete_snapshot" :: held 2.309s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:57:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] Lock "cinder-quobyte-c693c834-a13f-4f44-ba82-be79bdf6dedc" released by "delete_snapshot" :: held 2.335s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:57:37 devstack cinder-volume[86082]: WARNING cinder.quota [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:57:37 devstack cinder-volume[86082]: DEBUG cinder.quota [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] Created reservations ['62413196-aa2c-4a56-b823-a20fb2e99dc4', '0f9c023e-d356-4b26-9463-207ba727eca5', '0d573e66-e602-453e-b6c9-3e2f0f4e3385', 'f96876a2-3996-4572-9086-a105a803a5c1'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:57:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] Delete snapshot completed successfully. Sep 17 14:57:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-97fcf412-e3ca-4a49-a0e5-f9e827377ea3 req-bc6c3228-60e1-4011-9eae-d660803be06d tempest-VolumesSnapshotsTestJSON-1045311572 None] Lock "cinder-a860345f-4648-499c-b2c1-4a26cfc90fa2-delete_snapshot" released by "delete_snapshot" :: held 2.535s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:57:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] Acquiring lock "cinder-c693c834-a13f-4f44-ba82-be79bdf6dedc-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:57:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] Lock "cinder-c693c834-a13f-4f44-ba82-be79bdf6dedc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:57:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] Acquiring lock "cinder-quobyte-c693c834-a13f-4f44-ba82-be79bdf6dedc" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:57:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] Lock "cinder-quobyte-c693c834-a13f-4f44-ba82-be79bdf6dedc" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:57:38 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c93e7d0-c836-4920-8dcd-425739c6e5ac]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:57:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:38 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc Sep 17 14:57:38 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:38 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc" returned: 0 in 0.427s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:38 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc Sep 17 14:57:38 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:39 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c693c834-a13f-4f44-ba82-be79bdf6dedc" returned: 0 in 0.307s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] Lock "cinder-quobyte-c693c834-a13f-4f44-ba82-be79bdf6dedc" released by "delete_volume" :: held 0.820s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:57:39 devstack cinder-volume[86082]: DEBUG cinder.quota [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] Created reservations ['32f656fa-c546-4227-9a6b-53fcc8eae36f', '4fbb488f-d98d-47af-bfdf-d2e20868b39e', 'bd545ba0-df12-4a9b-9e16-e310beddfaf1', 'de63905a-5714-4100-b78a-1c8a5400f518'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:57:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:57:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:57:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:39 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:57:39 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:39 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.298s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:39 devstack cinder-volume[86082]: DEBUG cinder.manager [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:57:39 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] Deleted volume successfully. Sep 17 14:57:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-712c8873-ae2c-4133-bfdc-16a2df1aa2fe req-cf00c2fb-e686-4e7b-acae-43acd3abf20c tempest-VolumesSnapshotsTestJSON-1045311572 None] Lock "cinder-c693c834-a13f-4f44-ba82-be79bdf6dedc-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:57:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:57:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:57:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:57:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:40 devstack sudo[87962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:57:40 devstack sudo[87962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:40 devstack sudo[87962]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.391s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:57:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:57:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 8 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 14:57:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 14:57:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c8f00d33-3a40-4498-a80b-4cd6cdda72e3 tempest-BackendsCapabilitiesAdminTestsJSON-165676314 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8068466186523, 'free_capacity_gb': 1775.8068466186523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86082) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 17 14:57:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-733b3e73-96c9-4024-b7df-a0c560376ac2 tempest-BackendsCapabilitiesAdminTestsJSON-165676314 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8068466186523, 'free_capacity_gb': 1775.8068466186523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86082) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 17 14:57:56 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=44,cinder:SELECT=40,cinder:INSERT=10,cinder:DELETE=4 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:57:56 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=40,cinder:UPDATE=46,cinder:DELETE=4,cinder:INSERT=11 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:57:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-90c4dedb-00b6-48ed-9058-addffb521fda tempest-GroupSnapshotsTest-249152645 None] Group tempest-GroupSnapshotsTest-Group-623221327: creating Sep 17 14:57:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-90c4dedb-00b6-48ed-9058-addffb521fda tempest-GroupSnapshotsTest-249152645 None] Group tempest-GroupSnapshotsTest-Group-623221327: created successfully Sep 17 14:57:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-90c4dedb-00b6-48ed-9058-addffb521fda tempest-GroupSnapshotsTest-249152645 None] Create group completed successfully. Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Flow 'volume_create_manager' (a9408551-bdaf-4e29-b3f6-87d216ffe3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968a4305-b40b-4e61-b54d-a20f1aa8ac2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968a4305-b40b-4e61-b54d-a20f1aa8ac2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-352195258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95bbfc44-224d-481c-9760-baeb1d976c57,host='devstack@QuobyteHD#QuobyteHD',id=81216f39-b350-4694-96ac-e088d59f2668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc6177bcf5d4dd6a0027946da2d5a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:58:00Z,use_quota=True,user_id='ce20adb030c342d1b713d6f7ddc7d170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(065a37b4-5b6b-430f-a81d-b32f65212ea6),volume_type_id=065a37b4-5b6b-430f-a81d-b32f65212ea6)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f40dcf-11bd-41b6-bcbd-44af0b89b28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f40dcf-11bd-41b6-bcbd-44af0b89b28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8288bab2-ab37-43ad-a137-30ad4d168e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8288bab2-ab37-43ad-a137-30ad4d168e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81216f39-b350-4694-96ac-e088d59f2668', 'volume_name': 'volume-81216f39-b350-4694-96ac-e088d59f2668', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37913a6-3de8-483f-8a3d-ff3809b1182e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37913a6-3de8-483f-8a3d-ff3809b1182e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba01e320-0b72-4581-8a1e-ccaa942dafff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:59 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Volume 81216f39-b350-4694-96ac-e088d59f2668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81216f39-b350-4694-96ac-e088d59f2668', 'volume_size': 1} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95bbfc44-224d-481c-9760-baeb1d976c57,created_at=2026-09-17T12:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-352195258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95bbfc44-224d-481c-9760-baeb1d976c57,host='devstack@QuobyteHD#QuobyteHD',id=81216f39-b350-4694-96ac-e088d59f2668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc6177bcf5d4dd6a0027946da2d5a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:58:00Z,use_quota=True,user_id='ce20adb030c342d1b713d6f7ddc7d170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(065a37b4-5b6b-430f-a81d-b32f65212ea6),volume_type_id=065a37b4-5b6b-430f-a81d-b32f65212ea6)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Creating volume 81216f39-b350-4694-96ac-e088d59f2668 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:57:59 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 14:57:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:59 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 1073741824 Sep 17 14:57:59 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:00 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 1073741824" returned: 0 in 0.831s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:00 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 Sep 17 14:58:00 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:01 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668" returned: 0 in 0.578s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:58:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba01e320-0b72-4581-8a1e-ccaa942dafff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81216f39-b350-4694-96ac-e088d59f2668', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99ded5e-22d6-4051-a34c-883fccba044e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:01 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Volume volume-81216f39-b350-4694-96ac-e088d59f2668 (81216f39-b350-4694-96ac-e088d59f2668): created successfully Sep 17 14:58:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99ded5e-22d6-4051-a34c-883fccba044e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Flow 'volume_create_manager' (a9408551-bdaf-4e29-b3f6-87d216ffe3c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:58:01 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b7620271-8d67-4612-bea5-b5e44372b86b tempest-GroupSnapshotsTest-249152645 None] Created volume successfully. Sep 17 14:58:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] GroupSnapshot b5e3b7c9-f811-4d53-ad9c-70f1f70f40d3: creating. Sep 17 14:58:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] Group snapshot b5e3b7c9-f811-4d53-ad9c-70f1f70f40d3: creating. {{(pid=86082) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 14:58:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] Creating offline snapshot 58827b18-a791-45d7-9269-e983610aa325 of volume 81216f39-b350-4694-96ac-e088d59f2668 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 14:58:03 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbaaaf6-08a9-4565-9e0f-a4ca4d4c35fe]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:58:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:04 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 Sep 17 14:58:04 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:04 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668" returned: 0 in 0.587s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:04 devstack sudo[88267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325 1G Sep 17 14:58:04 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:05 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325 1G" returned: 0 in 0.964s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81216f39-b350-4694-96ac-e088d59f2668 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:05 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81216f39-b350-4694-96ac-e088d59f2668 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325 Sep 17 14:58:05 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:05 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81216f39-b350-4694-96ac-e088d59f2668 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325" returned: 0 in 0.451s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:05 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 14:58:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:05 devstack sudo[88282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325 Sep 17 14:58:05 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:06 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325" returned: 0 in 0.304s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:06 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.info Sep 17 14:58:06 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:06 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.info" returned: 0 in 0.462s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:06 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 14:58:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:06 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.info Sep 17 14:58:06 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:07 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.info" returned: 0 in 0.467s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.375s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-cffbb0de-2efe-4911-933e-ad0566f7193f tempest-GroupSnapshotsTest-249152645 None] group_snapshot b5e3b7c9-f811-4d53-ad9c-70f1f70f40d3: created successfully Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "cinder-quobyte-58827b18-a791-45d7-9269-e983610aa325-72485c94-fe37-4e6d-abc3-06ef652bb58d" by "_create_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-58827b18-a791-45d7-9269-e983610aa325-72485c94-fe37-4e6d-abc3-06ef652bb58d" acquired by "_create_volume_from_snapshot" :: waited 0.056s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Creating volume 72485c94-fe37-4e6d-abc3-06ef652bb58d from snapshot 58827b18-a791-45d7-9269-e983610aa325 {{(pid=86082) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "cinder-quobyte-72485c94-fe37-4e6d-abc3-06ef652bb58d" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-72485c94-fe37-4e6d-abc3-06ef652bb58d" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] snapshot: 58827b18-a791-45d7-9269-e983610aa325, volume: 72485c94-fe37-4e6d-abc3-06ef652bb58d, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5243d07c-c632-4ba7-90af-b44b4c9a5475]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:58:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:10 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325 Sep 17 14:58:10 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:10 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325" returned: 0 in 0.766s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81216f39-b350-4694-96ac-e088d59f2668(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 14:58:10 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[89930e1f-6ca3-4c0e-a105-c7a4127150eb]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:58:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:10 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 Sep 17 14:58:10 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-e05256b5-7f70-41ad-8afe-d03833979ac4 req-6c2ce7c9-659c-4a91-ba41-4bba750fd7aa tempest-ServerActionsTestOtherA-1114292147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:11 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668" returned: 0 in 0.669s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 14:58:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 14:58:11 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Path /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-72485c94-fe37-4e6d-abc3-06ef652bb58d not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 14:58:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-72485c94-fe37-4e6d-abc3-06ef652bb58d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:11 devstack sudo[88355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-72485c94-fe37-4e6d-abc3-06ef652bb58d Sep 17 14:58:11 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:19 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:58:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Flow 'volume_create_manager' (69379df0-d5b5-4ef2-af3c-19ad81bf4ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:58:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d03c8fb-9b71-4a00-9dfd-8bbb43396ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d03c8fb-9b71-4a00-9dfd-8bbb43396ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-304449972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0a7f77-98a3-40f1-b770-d08f2f9e82f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1699a1d5ff4e7f9ec8ac73b993c10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:58:19Z,use_quota=True,user_id='02888bedfa6140ed8c92daba164baee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9081c9-827d-4455-aff0-01345913ef11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9081c9-827d-4455-aff0-01345913ef11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5cb24e5-f6f0-4126-a45c-f3fd8b52a72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5cb24e5-f6f0-4126-a45c-f3fd8b52a72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b0a7f77-98a3-40f1-b770-d08f2f9e82f9', 'volume_name': 'volume-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f322e56-185d-4fdc-88d7-9c1d180c7314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f322e56-185d-4fdc-88d7-9c1d180c7314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65174d25-28f8-4373-818d-6e00c428584d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:19 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Volume 5b0a7f77-98a3-40f1-b770-d08f2f9e82f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9', 'volume_size': 1} Sep 17 14:58:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:23 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-72485c94-fe37-4e6d-abc3-06ef652bb58d" returned: 0 in 12.015s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Image conversion details: src /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668, size 1024.00 MB, duration 12.02 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-72485c94-fe37-4e6d-abc3-06ef652bb58d {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 14:58:23 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Converted 1024.00 MB image at 85.21 MB/s Sep 17 14:58:23 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-72485c94-fe37-4e6d-abc3-06ef652bb58d is being set with open permissions: ugo+rw: NotImplementedError Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-72485c94-fe37-4e6d-abc3-06ef652bb58d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:23 devstack sudo[88426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-72485c94-fe37-4e6d-abc3-06ef652bb58d Sep 17 14:58:23 devstack sudo[88426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:23 devstack sudo[88426]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-72485c94-fe37-4e6d-abc3-06ef652bb58d" returned: 0 in 0.464s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-72485c94-fe37-4e6d-abc3-06ef652bb58d" released by "_copy_volume_from_snapshot" :: held 14.141s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-58827b18-a791-45d7-9269-e983610aa325-72485c94-fe37-4e6d-abc3-06ef652bb58d" released by "_create_volume_from_snapshot" :: held 14.265s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.323s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-e05256b5-7f70-41ad-8afe-d03833979ac4 req-6c2ce7c9-659c-4a91-ba41-4bba750fd7aa tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.679s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-e05256b5-7f70-41ad-8afe-d03833979ac4 req-6c2ce7c9-659c-4a91-ba41-4bba750fd7aa tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.126s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.537s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-304449972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0a7f77-98a3-40f1-b770-d08f2f9e82f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc1699a1d5ff4e7f9ec8ac73b993c10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:58:19Z,use_quota=True,user_id='02888bedfa6140ed8c92daba164baee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Creating volume 5b0a7f77-98a3-40f1-b770-d08f2f9e82f9 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:58:23 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 14:58:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:24 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9 1073741824 Sep 17 14:58:24 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-e05256b5-7f70-41ad-8afe-d03833979ac4 req-6c2ce7c9-659c-4a91-ba41-4bba750fd7aa tempest-ServerActionsTestOtherA-1114292147 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-9d44f1fc-260a-4c69-93a3-8c3dc885f04d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4206ef4-b12f-40ac-9ab8-12c292b03ff3', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 14:58:24 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ecf1946b-9633-4e51-912a-87f92a028942 tempest-GroupSnapshotsTest-249152645 None] Create group from source-snapshot-b5e3b7c9-f811-4d53-ad9c-70f1f70f40d3 completed successfully. Sep 17 14:58:24 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-e05256b5-7f70-41ad-8afe-d03833979ac4 req-6c2ce7c9-659c-4a91-ba41-4bba750fd7aa tempest-ServerActionsTestOtherA-1114292147 None] attachment_update completed successfully. Sep 17 14:58:24 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9 1073741824" returned: 0 in 0.920s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:25 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9 Sep 17 14:58:25 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:25 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9" returned: 0 in 0.416s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:58:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65174d25-28f8-4373-818d-6e00c428584d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b89b3b9-d129-4e45-8187-3c253f159879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:25 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Volume volume-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9 (5b0a7f77-98a3-40f1-b770-d08f2f9e82f9): created successfully Sep 17 14:58:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b89b3b9-d129-4e45-8187-3c253f159879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Flow 'volume_create_manager' (69379df0-d5b5-4ef2-af3c-19ad81bf4ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:58:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1c7de5f7-e38d-4f5f-bd88-59e4c8961371 tempest-ServerRescueNegativeTestJSON-1265758866 None] Created volume successfully. Sep 17 14:58:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "cinder-quobyte-72485c94-fe37-4e6d-abc3-06ef652bb58d" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:58:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-72485c94-fe37-4e6d-abc3-06ef652bb58d" acquired by "delete_volume" :: waited 0.047s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:58:25 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b44933-ed07-465c-9e11-c92e1fdc27eb]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:58:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-72485c94-fe37-4e6d-abc3-06ef652bb58d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:26 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-72485c94-fe37-4e6d-abc3-06ef652bb58d Sep 17 14:58:26 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:26 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-72485c94-fe37-4e6d-abc3-06ef652bb58d" returned: 0 in 0.739s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-72485c94-fe37-4e6d-abc3-06ef652bb58d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:26 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-72485c94-fe37-4e6d-abc3-06ef652bb58d Sep 17 14:58:26 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:26 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-72485c94-fe37-4e6d-abc3-06ef652bb58d" returned: 0 in 0.366s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-72485c94-fe37-4e6d-abc3-06ef652bb58d" released by "delete_volume" :: held 1.248s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:58:27 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] Created reservations ['e426bcad-60ce-4bce-94e2-6d9fcab3f18c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:58:27 devstack cinder-volume[86082]: WARNING cinder.quota [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-681984416 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-681984416, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:58:27 devstack cinder-volume[86082]: WARNING cinder.quota [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-681984416 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-681984416, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:58:27 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] Created reservations ['2f521077-bc9e-4bb8-86d0-d5ee63e0f941', '5fd1b02c-5701-441e-9470-ca8a2caa9b45', '9ea000fa-d302-40e5-8089-0c72a559a3e8', '06417bf2-9d6e-4869-8d29-3a87f9dc51d5'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:58:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:58:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:58:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:27 devstack sudo[88865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:58:27 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:27 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.446s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:27 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:58:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-136fba6e-db5f-497d-be2c-800c9adad35d tempest-GroupSnapshotsTest-249152645 None] Delete group completed successfully. Sep 17 14:58:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] group_snapshot b5e3b7c9-f811-4d53-ad9c-70f1f70f40d3: deleting Sep 17 14:58:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] group_snapshot b5e3b7c9-f811-4d53-ad9c-70f1f70f40d3: deleting {{(pid=86082) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 14:58:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "cinder-quobyte-81216f39-b350-4694-96ac-e088d59f2668" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:58:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-81216f39-b350-4694-96ac-e088d59f2668" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:58:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "cinder-quobyte-58827b18-a791-45d7-9269-e983610aa325" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:58:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-58827b18-a791-45d7-9269-e983610aa325" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:58:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] Deleting offline snapshot 58827b18-a791-45d7-9269-e983610aa325 of volume 81216f39-b350-4694-96ac-e088d59f2668 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 14:58:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] snapshot_file for this snap is: volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 14:58:28 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c01667-6f43-43a0-90e0-fd9b379897f7]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:58:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:28 devstack sudo[88905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325 Sep 17 14:58:28 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:29 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325" returned: 0 in 0.539s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81216f39-b350-4694-96ac-e088d59f2668(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c487fa53-572c-41f2-9a92-8dec136063f7]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Flow 'volume_create_manager' (88dd5c60-50ce-4f07-b690-8e00b90bdc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8abc2eb-0535-4042-ba82-004353bff17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-ecde88b4-9c7d-4e49-86f3-47aeb1b201a5 req-f6a1785b-6ee4-4377-834f-d481ce7cd6a6 tempest-ServerActionsTestOtherA-1114292147 None] Terminate volume connection completed successfully. Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-ecde88b4-9c7d-4e49-86f3-47aeb1b201a5 req-f6a1785b-6ee4-4377-834f-d481ce7cd6a6 tempest-ServerActionsTestOtherA-1114292147 None] Deleting attachment f4206ef4-b12f-40ac-9ab8-12c292b03ff3. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8abc2eb-0535-4042-ba82-004353bff17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1090712404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63eeb2e2-3452-499c-b1f9-97e11f61531b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d47eaeb7184225a715d05ed701936d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:58:29Z,use_quota=True,user_id='e95187a0ce1349a384f8c750b8087186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e19a8955-9385-4615-85d0-03b9949b671f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e19a8955-9385-4615-85d0-03b9949b671f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0d50ef-c471-4aab-8ac8-1bd683e7cc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0d50ef-c471-4aab-8ac8-1bd683e7cc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63eeb2e2-3452-499c-b1f9-97e11f61531b', 'volume_name': 'volume-63eeb2e2-3452-499c-b1f9-97e11f61531b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9761a313-ad67-4874-a43a-3e4509c6d0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9761a313-ad67-4874-a43a-3e4509c6d0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe528bb4-e093-4d26-8d1f-ad061b1e1db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:29 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Volume 63eeb2e2-3452-499c-b1f9-97e11f61531b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63eeb2e2-3452-499c-b1f9-97e11f61531b', 'volume_size': 1} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1090712404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63eeb2e2-3452-499c-b1f9-97e11f61531b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d47eaeb7184225a715d05ed701936d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:58:29Z,use_quota=True,user_id='e95187a0ce1349a384f8c750b8087186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Creating volume 63eeb2e2-3452-499c-b1f9-97e11f61531b {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:58:29 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 14:58:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-63eeb2e2-3452-499c-b1f9-97e11f61531b 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:29 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 Sep 17 14:58:29 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:29 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-63eeb2e2-3452-499c-b1f9-97e11f61531b 1073741824 Sep 17 14:58:29 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:30 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:30 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-63eeb2e2-3452-499c-b1f9-97e11f61531b 1073741824" returned: 0 in 0.983s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668" returned: 0 in 1.127s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:30 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325 Sep 17 14:58:30 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-63eeb2e2-3452-499c-b1f9-97e11f61531b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:30 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-63eeb2e2-3452-499c-b1f9-97e11f61531b Sep 17 14:58:30 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-ecde88b4-9c7d-4e49-86f3-47aeb1b201a5 req-ff8a2b00-d4f0-42f2-97af-2d852fb4fab8 tempest-ServerActionsTestOtherA-1114292147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:31 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-63eeb2e2-3452-499c-b1f9-97e11f61531b" returned: 0 in 0.449s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:58:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-ecde88b4-9c7d-4e49-86f3-47aeb1b201a5 req-ff8a2b00-d4f0-42f2-97af-2d852fb4fab8 tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.071s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe528bb4-e093-4d26-8d1f-ad061b1e1db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63eeb2e2-3452-499c-b1f9-97e11f61531b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abec699a-87d4-4a09-870c-2f34c49c7152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-ecde88b4-9c7d-4e49-86f3-47aeb1b201a5 req-ff8a2b00-d4f0-42f2-97af-2d852fb4fab8 tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:31 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Volume volume-63eeb2e2-3452-499c-b1f9-97e11f61531b (63eeb2e2-3452-499c-b1f9-97e11f61531b): created successfully Sep 17 14:58:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abec699a-87d4-4a09-870c-2f34c49c7152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Flow 'volume_create_manager' (88dd5c60-50ce-4f07-b690-8e00b90bdc7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:58:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7189ef8a-4581-4bed-a69d-38bb90a0bc66 tempest-TaggedAttachmentsTest-1146269432 None] Created volume successfully. Sep 17 14:58:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-ecde88b4-9c7d-4e49-86f3-47aeb1b201a5 req-ff8a2b00-d4f0-42f2-97af-2d852fb4fab8 tempest-ServerActionsTestOtherA-1114292147 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-9d44f1fc-260a-4c69-93a3-8c3dc885f04d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6c58ae9-0f8c-4c63-b850-af52589f52b4', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 14:58:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-ecde88b4-9c7d-4e49-86f3-47aeb1b201a5 req-ff8a2b00-d4f0-42f2-97af-2d852fb4fab8 tempest-ServerActionsTestOtherA-1114292147 None] attachment_update completed successfully. Sep 17 14:58:31 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325" returned: 0 in 0.832s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:31 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325 Sep 17 14:58:31 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:31 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668.58827b18-a791-45d7-9269-e983610aa325" returned: 0 in 0.475s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-58827b18-a791-45d7-9269-e983610aa325" released by "_delete_snapshot" :: held 3.198s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:58:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-81216f39-b350-4694-96ac-e088d59f2668" released by "delete_snapshot" :: held 3.270s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:58:32 devstack cinder-volume[86082]: WARNING cinder.quota [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-681984416 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-681984416, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:58:32 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] Created reservations ['27d4e600-615b-4eea-a697-0ed9c30ee11e', '9d8b08d5-3e33-4a1d-891d-eb9797f454a4', '24e49f17-47c3-4689-bcdf-fc4565dd6e66', 'ae7e365a-b429-4a8c-af39-095a95014c73'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:58:32 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-17a70f5a-36b5-42af-8e48-004bb2eaec13 tempest-GroupSnapshotsTest-249152645 None] group_snapshot b5e3b7c9-f811-4d53-ad9c-70f1f70f40d3: deleted successfully Sep 17 14:58:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "cinder-quobyte-81216f39-b350-4694-96ac-e088d59f2668" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:58:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-81216f39-b350-4694-96ac-e088d59f2668" acquired by "delete_volume" :: waited 0.039s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:58:33 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3091c2-3ee0-4935-9740-45dbfb59267a]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:58:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:34 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 Sep 17 14:58:34 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:34 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668" returned: 0 in 0.652s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:34 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668 Sep 17 14:58:34 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:34 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-81216f39-b350-4694-96ac-e088d59f2668" returned: 0 in 0.370s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-81216f39-b350-4694-96ac-e088d59f2668" released by "delete_volume" :: held 1.240s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:58:35 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] Created reservations ['ef9f0781-dc51-4817-9388-ecfc550ad54c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:58:35 devstack cinder-volume[86082]: WARNING cinder.db.api [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-681984416'] Sep 17 14:58:35 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] Created reservations ['b670bfdd-9898-48af-8a3c-74285d6a55b8', 'b43ba8c1-bf22-4a11-81d3-7f0ae5db7c0e', '660aea87-6563-4d24-b767-04af1fb47ba0', 'ffc8f503-284c-4fa0-86c9-f6f51e4c94c1'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:58:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:58:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:58:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:35 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:58:35 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:36 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.621s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:36 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:58:36 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8f036b58-b5ff-481b-b8ef-411041aeb5c0 tempest-GroupSnapshotsTest-249152645 None] Delete group completed successfully. Sep 17 14:58:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-82aae324-3d84-4ac4-a2db-a98d869bae9a tempest-GroupSnapshotsTest-249152645 None] Group tempest-GroupSnapshotsTest-Group-1523925895: creating Sep 17 14:58:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-82aae324-3d84-4ac4-a2db-a98d869bae9a tempest-GroupSnapshotsTest-249152645 None] Group tempest-GroupSnapshotsTest-Group-1523925895: created successfully Sep 17 14:58:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-82aae324-3d84-4ac4-a2db-a98d869bae9a tempest-GroupSnapshotsTest-249152645 None] Create group completed successfully. Sep 17 14:58:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] Acquiring lock "cinder-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:58:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] Lock "cinder-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:58:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] Acquiring lock "cinder-quobyte-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:58:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] Lock "cinder-quobyte-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9" acquired by "delete_volume" :: waited 0.047s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:58:38 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b49f080-df86-4d4b-90cd-b8e4fa7dfee4]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:58:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:38 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9 Sep 17 14:58:38 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:39 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9" returned: 0 in 1.073s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:39 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9 Sep 17 14:58:39 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:39 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:58:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Flow 'volume_create_manager' (ea4de9f1-2f21-47f2-9fa1-8dd5e3bdfd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:58:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0c1580-c831-487a-a90d-a51700e584a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0c1580-c831-487a-a90d-a51700e584a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1677846647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=86067e51-8b41-4d9e-9cb1-1073185b0da7,host='devstack@QuobyteHD#QuobyteHD',id=7349cfed-55b5-4fff-a48f-ed1beaa3427c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc6177bcf5d4dd6a0027946da2d5a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:58:40Z,use_quota=True,user_id='ce20adb030c342d1b713d6f7ddc7d170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f75bb260-c612-4c19-98c8-179cc203e33b),volume_type_id=f75bb260-c612-4c19-98c8-179cc203e33b)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb14e708-baf4-4c34-8cc2-3f06a707eac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb14e708-baf4-4c34-8cc2-3f06a707eac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd61a503-3f52-4168-8825-a2d9e26e9ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd61a503-3f52-4168-8825-a2d9e26e9ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7349cfed-55b5-4fff-a48f-ed1beaa3427c', 'volume_name': 'volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1898de57-22f2-4741-b131-78570f386335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1898de57-22f2-4741-b131-78570f386335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcb0ecd-271c-4125-857d-8db3da2d89a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:40 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Volume 7349cfed-55b5-4fff-a48f-ed1beaa3427c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c', 'volume_size': 1} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=86067e51-8b41-4d9e-9cb1-1073185b0da7,created_at=2026-09-17T12:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1677846647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=86067e51-8b41-4d9e-9cb1-1073185b0da7,host='devstack@QuobyteHD#QuobyteHD',id=7349cfed-55b5-4fff-a48f-ed1beaa3427c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc6177bcf5d4dd6a0027946da2d5a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:58:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:58:40Z,use_quota=True,user_id='ce20adb030c342d1b713d6f7ddc7d170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f75bb260-c612-4c19-98c8-179cc203e33b),volume_type_id=f75bb260-c612-4c19-98c8-179cc203e33b)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Creating volume 7349cfed-55b5-4fff-a48f-ed1beaa3427c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:58:40 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:40 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c 1073741824 Sep 17 14:58:40 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:40 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9" returned: 0 in 0.549s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] Lock "cinder-quobyte-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9" released by "delete_volume" :: held 1.759s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] Created reservations ['d7048d70-2d0e-45ee-b01d-fb26629cdc90', '5abbda30-22e6-45ad-bf1f-c016a34461b0', '91af2bba-6229-4fda-ac3a-cf03fce68903', '8fc648d6-92ba-49d1-89fc-782d9cd1dc61'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:40 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:58:40 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:40 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:58:40 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:41 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.624s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:41 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:58:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] Deleted volume successfully. Sep 17 14:58:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d865096-eced-4707-87a6-996d33489fc9 tempest-ServerRescueNegativeTestJSON-1265758866 None] Lock "cinder-5b0a7f77-98a3-40f1-b770-d08f2f9e82f9-delete_volume" released by "delete_volume" :: held 2.967s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:58:41 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 1.035s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:41 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:58:41 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:58:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 8 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 14:58:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 14:58:41 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c 1073741824" returned: 0 in 1.468s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:41 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c Sep 17 14:58:41 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:42 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c" returned: 0 in 0.641s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] <== create_volume: return (2222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:58:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcb0ecd-271c-4125-857d-8db3da2d89a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e7b2a3-1187-43e1-8a1f-d86012cbe814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:42 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Volume volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c (7349cfed-55b5-4fff-a48f-ed1beaa3427c): created successfully Sep 17 14:58:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e7b2a3-1187-43e1-8a1f-d86012cbe814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Flow 'volume_create_manager' (ea4de9f1-2f21-47f2-9fa1-8dd5e3bdfd44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:58:42 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4c0295fa-0848-46e5-b992-35903bb8d72e tempest-GroupSnapshotsTest-249152645 None] Created volume successfully. Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Flow 'volume_create_manager' (873a8cdb-810b-4c93-82f3-a032de47179b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a38e2d56-bc8b-4035-a439-940ae56fc8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a38e2d56-bc8b-4035-a439-940ae56fc8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-854249100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=86067e51-8b41-4d9e-9cb1-1073185b0da7,host='devstack@QuobyteHD#QuobyteHD',id=b174fdfc-a42b-4382-b3b1-b59419d88277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc6177bcf5d4dd6a0027946da2d5a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:58:45Z,use_quota=True,user_id='ce20adb030c342d1b713d6f7ddc7d170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f75bb260-c612-4c19-98c8-179cc203e33b),volume_type_id=f75bb260-c612-4c19-98c8-179cc203e33b)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557e138f-fb66-4a17-97ba-6bc186d3a481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557e138f-fb66-4a17-97ba-6bc186d3a481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ed0b58-3375-4168-a80e-84e122347a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ed0b58-3375-4168-a80e-84e122347a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b174fdfc-a42b-4382-b3b1-b59419d88277', 'volume_name': 'volume-b174fdfc-a42b-4382-b3b1-b59419d88277', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cef6e4-69ab-48f5-bd22-77b854c3bae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00cef6e4-69ab-48f5-bd22-77b854c3bae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7806384b-3bc9-4cd3-82fa-d86aa61c6750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:45 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Volume b174fdfc-a42b-4382-b3b1-b59419d88277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b174fdfc-a42b-4382-b3b1-b59419d88277', 'volume_size': 1} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=86067e51-8b41-4d9e-9cb1-1073185b0da7,created_at=2026-09-17T12:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-854249100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=86067e51-8b41-4d9e-9cb1-1073185b0da7,host='devstack@QuobyteHD#QuobyteHD',id=b174fdfc-a42b-4382-b3b1-b59419d88277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc6177bcf5d4dd6a0027946da2d5a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:58:45Z,use_quota=True,user_id='ce20adb030c342d1b713d6f7ddc7d170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f75bb260-c612-4c19-98c8-179cc203e33b),volume_type_id=f75bb260-c612-4c19-98c8-179cc203e33b)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Creating volume b174fdfc-a42b-4382-b3b1-b59419d88277 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:58:45 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 14:58:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:45 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277 1073741824 Sep 17 14:58:45 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:46 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277 1073741824" returned: 0 in 0.863s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:46 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277 Sep 17 14:58:46 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:46 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277" returned: 0 in 0.393s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:58:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7806384b-3bc9-4cd3-82fa-d86aa61c6750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b174fdfc-a42b-4382-b3b1-b59419d88277', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdbc497-d189-44d0-8aac-0779ee2bd202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:47 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Volume volume-b174fdfc-a42b-4382-b3b1-b59419d88277 (b174fdfc-a42b-4382-b3b1-b59419d88277): created successfully Sep 17 14:58:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfdbc497-d189-44d0-8aac-0779ee2bd202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Flow 'volume_create_manager' (873a8cdb-810b-4c93-82f3-a032de47179b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:58:47 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ce026574-1570-4ecd-b9a9-8859409e4c09 tempest-GroupSnapshotsTest-249152645 None] Created volume successfully. Sep 17 14:58:48 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e5aa06aa-77e6-4711-bfd0-5c01dc4936b6 tempest-GroupSnapshotsTest-249152645 None] Update group completed successfully. Sep 17 14:58:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f356e493-16d3-4ff4-934d-c182e0553e37 tempest-GroupSnapshotsTest-249152645 None] Update group completed successfully. Sep 17 14:58:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c6e02871-2f25-4ae3-8ad2-da5f5b8f4b8c tempest-GroupSnapshotsTest-249152645 None] Update group completed successfully. Sep 17 14:58:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-bdebf1cc-ae95-4fd9-8731-eec79f4b304f tempest-GroupSnapshotsTest-249152645 None] Update group completed successfully. Sep 17 14:58:54 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] GroupSnapshot 15e1d29d-c0cc-4e0f-bf47-fb57cdd5f2ef: creating. Sep 17 14:58:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Group snapshot 15e1d29d-c0cc-4e0f-bf47-fb57cdd5f2ef: creating. {{(pid=86082) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 14:58:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Creating offline snapshot a513c1ba-a8bd-43c8-9ec2-11c5169a7001 of volume 7349cfed-55b5-4fff-a48f-ed1beaa3427c {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 14:58:54 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bcf748-2392-430e-aec2-540583bf2736]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:58:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:54 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c Sep 17 14:58:54 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:55 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c" returned: 0 in 0.547s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:55 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001 1G Sep 17 14:58:55 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:55 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001 1G" returned: 0 in 0.540s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:55 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001 Sep 17 14:58:55 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:55 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001" returned: 0 in 0.336s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:55 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 14:58:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:56 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001 Sep 17 14:58:56 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:56 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001" returned: 0 in 0.337s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:56 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.info Sep 17 14:58:56 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:56 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.info" returned: 0 in 0.307s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:56 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 14:58:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:56 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.info Sep 17 14:58:56 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:56 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.info" returned: 0 in 0.289s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.512s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:57 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=81,cinder:UPDATE=62,cinder:INSERT=15,cinder:DELETE=3 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:58:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Creating offline snapshot c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7 of volume b174fdfc-a42b-4382-b3b1-b59419d88277 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 14:58:57 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6024063-0f2a-4b7c-8afc-d64eb4c83b40]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:58:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:57 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277 Sep 17 14:58:57 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:57 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277" returned: 0 in 0.460s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:57 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7 1G Sep 17 14:58:57 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:58 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7 1G" returned: 0 in 0.506s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b174fdfc-a42b-4382-b3b1-b59419d88277 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:58 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b174fdfc-a42b-4382-b3b1-b59419d88277 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7 Sep 17 14:58:58 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:58 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b174fdfc-a42b-4382-b3b1-b59419d88277 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7" returned: 0 in 0.357s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:58 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 14:58:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:58 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7 Sep 17 14:58:58 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:58 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7" returned: 0 in 0.310s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:58 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=66,cinder:SELECT=77,cinder:DELETE=3,cinder:INSERT=11 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:58:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:58 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.info Sep 17 14:58:58 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:59 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.info" returned: 0 in 0.414s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:59 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 14:58:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:59 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.info Sep 17 14:58:59 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:59 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.info" returned: 0 in 0.405s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.601s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4fa3b51f-845b-4154-8a4e-7dedb87c6244 tempest-GroupSnapshotsTest-249152645 None] group_snapshot 15e1d29d-c0cc-4e0f-bf47-fb57cdd5f2ef: created successfully Sep 17 14:59:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] group_snapshot 15e1d29d-c0cc-4e0f-bf47-fb57cdd5f2ef: deleting Sep 17 14:59:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] group_snapshot 15e1d29d-c0cc-4e0f-bf47-fb57cdd5f2ef: deleting {{(pid=86082) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 14:59:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "cinder-quobyte-7349cfed-55b5-4fff-a48f-ed1beaa3427c" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-7349cfed-55b5-4fff-a48f-ed1beaa3427c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "cinder-quobyte-a513c1ba-a8bd-43c8-9ec2-11c5169a7001" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-a513c1ba-a8bd-43c8-9ec2-11c5169a7001" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Deleting offline snapshot a513c1ba-a8bd-43c8-9ec2-11c5169a7001 of volume 7349cfed-55b5-4fff-a48f-ed1beaa3427c {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 14:59:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] snapshot_file for this snap is: volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 14:59:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d28a65-dbfe-4347-9b09-fcb548efb4fe]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:00 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001 Sep 17 14:59:00 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:00 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001" returned: 0 in 0.550s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[89afeef8-d0bf-4f99-a53a-cd37363419f8]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:01 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c Sep 17 14:59:01 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Flow 'volume_create_manager' (e1b0cdab-9326-4a45-880d-bbbd081aedde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb9f70b-31fa-45db-9f77-bad987de8a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:01 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c" returned: 0 in 0.897s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb9f70b-31fa-45db-9f77-bad987de8a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-872212371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed8f56e-ed91-4794-943a-6f0799abbdcd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b191d7032b8649f48e7306d108e8f7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:02Z,use_quota=True,user_id='c9b1996c1efe4604a519a1ba9c13bfa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34af7817-08d6-4a28-8142-5468da4f103c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34af7817-08d6-4a28-8142-5468da4f103c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:01 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001 Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3523220a-ad85-424f-a3e4-eb1af0aeddf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:01 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3523220a-ad85-424f-a3e4-eb1af0aeddf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bed8f56e-ed91-4794-943a-6f0799abbdcd', 'volume_name': 'volume-bed8f56e-ed91-4794-943a-6f0799abbdcd', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae60a59-f81b-45cc-8eb6-6105ee9e5a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ae60a59-f81b-45cc-8eb6-6105ee9e5a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc03be35-2c64-47ba-a5d3-cf8d4ffe675d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:01 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Volume bed8f56e-ed91-4794-943a-6f0799abbdcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bed8f56e-ed91-4794-943a-6f0799abbdcd', 'volume_size': 1} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-872212371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed8f56e-ed91-4794-943a-6f0799abbdcd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b191d7032b8649f48e7306d108e8f7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:02Z,use_quota=True,user_id='c9b1996c1efe4604a519a1ba9c13bfa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Creating volume bed8f56e-ed91-4794-943a-6f0799abbdcd {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:59:01 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 14:59:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bed8f56e-ed91-4794-943a-6f0799abbdcd 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:02 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bed8f56e-ed91-4794-943a-6f0799abbdcd 1073741824 Sep 17 14:59:02 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:02 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001" returned: 0 in 0.516s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:02 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001 Sep 17 14:59:02 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:02 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bed8f56e-ed91-4794-943a-6f0799abbdcd 1073741824" returned: 0 in 0.579s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bed8f56e-ed91-4794-943a-6f0799abbdcd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:02 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bed8f56e-ed91-4794-943a-6f0799abbdcd Sep 17 14:59:02 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:02 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c.a513c1ba-a8bd-43c8-9ec2-11c5169a7001" returned: 0 in 0.338s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-a513c1ba-a8bd-43c8-9ec2-11c5169a7001" released by "_delete_snapshot" :: held 2.474s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-7349cfed-55b5-4fff-a48f-ed1beaa3427c" released by "delete_snapshot" :: held 2.540s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "cinder-quobyte-b174fdfc-a42b-4382-b3b1-b59419d88277" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-b174fdfc-a42b-4382-b3b1-b59419d88277" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "cinder-quobyte-c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Deleting offline snapshot c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7 of volume b174fdfc-a42b-4382-b3b1-b59419d88277 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 14:59:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] snapshot_file for this snap is: volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 14:59:02 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa13ddb1-6abb-4475-9028-6911742eb442]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:02 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bed8f56e-ed91-4794-943a-6f0799abbdcd" returned: 0 in 0.386s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:59:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc03be35-2c64-47ba-a5d3-cf8d4ffe675d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bed8f56e-ed91-4794-943a-6f0799abbdcd', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab0aa4f-27d6-47d3-90d3-906fa0d91feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:03 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7 Sep 17 14:59:03 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:03 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Volume volume-bed8f56e-ed91-4794-943a-6f0799abbdcd (bed8f56e-ed91-4794-943a-6f0799abbdcd): created successfully Sep 17 14:59:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab0aa4f-27d6-47d3-90d3-906fa0d91feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Flow 'volume_create_manager' (e1b0cdab-9326-4a45-880d-bbbd081aedde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b91959f7-c993-47f2-ad5b-2eed653c3311 tempest-VolumesTestJSON-1490010891 None] Created volume successfully. Sep 17 14:59:03 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7" returned: 0 in 0.480s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b174fdfc-a42b-4382-b3b1-b59419d88277(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 14:59:03 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4941b7fc-428a-437d-af2c-9914f335ea76]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-1d08ebdc-250f-4fd5-8c6d-abc58415cb97 req-5133bafd-f994-441a-bd7c-4d35d3aff6f2 tempest-ServerActionsTestOtherA-1114292147 None] Terminate volume connection completed successfully. Sep 17 14:59:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-1d08ebdc-250f-4fd5-8c6d-abc58415cb97 req-5133bafd-f994-441a-bd7c-4d35d3aff6f2 tempest-ServerActionsTestOtherA-1114292147 None] Deleting attachment a6c58ae9-0f8c-4c63-b850-af52589f52b4. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 14:59:03 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277 Sep 17 14:59:03 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:04 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277" returned: 0 in 0.544s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:04 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7 Sep 17 14:59:04 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Flow 'volume_create_manager' (134c2bfb-32a8-49b4-bd47-bae532e8eb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57c4f21-8c52-40c9-a8a4-b69298fde3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57c4f21-8c52-40c9-a8a4-b69298fde3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1335591211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f786ce3-2bd9-47bb-913e-0c6ca15b3df4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b191d7032b8649f48e7306d108e8f7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:04Z,use_quota=True,user_id='c9b1996c1efe4604a519a1ba9c13bfa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81074340-8f02-4b54-bb1b-ee45a0e9d7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81074340-8f02-4b54-bb1b-ee45a0e9d7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9f92ea-19e0-4529-9147-72e8b676297b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9f92ea-19e0-4529-9147-72e8b676297b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f786ce3-2bd9-47bb-913e-0c6ca15b3df4', 'volume_name': 'volume-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843bb8a8-bdce-47b1-9966-383736d94da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843bb8a8-bdce-47b1-9966-383736d94da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e9f226-8803-4469-babe-b3d9fbf9e1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:04 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Volume 2f786ce3-2bd9-47bb-913e-0c6ca15b3df4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4', 'volume_size': 1} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1335591211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f786ce3-2bd9-47bb-913e-0c6ca15b3df4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b191d7032b8649f48e7306d108e8f7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:04Z,use_quota=True,user_id='c9b1996c1efe4604a519a1ba9c13bfa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Creating volume 2f786ce3-2bd9-47bb-913e-0c6ca15b3df4 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:59:04 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:04 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4 1073741824 Sep 17 14:59:04 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:04 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7" returned: 0 in 0.568s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:04 devstack sudo[89957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7 Sep 17 14:59:04 devstack sudo[89957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:04 devstack sudo[89957]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277.c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7" returned: 0 in 0.375s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-c66ccf07-65f5-4ae1-9eb7-b8f06ddd42d7" released by "_delete_snapshot" :: held 2.111s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-b174fdfc-a42b-4382-b3b1-b59419d88277" released by "delete_snapshot" :: held 2.144s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:05 devstack cinder-volume[86082]: WARNING cinder.quota [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-17449729 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-17449729, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:59:05 devstack cinder-volume[86082]: WARNING cinder.quota [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-17449729 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-17449729, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:59:05 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4 1073741824" returned: 0 in 0.671s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:05 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Created reservations ['0a773e00-ffdd-43dc-886a-5b3ffa0a2196', '09ce6853-3bc7-42e5-8f6a-a77ad4104420', '57ff1c31-9a5c-4206-98d0-d893a7928d1f', '6dec1f7c-6807-48b1-85d2-d333c57d517b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:59:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:05 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4 Sep 17 14:59:05 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:05 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] Created reservations ['49e34adf-4181-4518-ae8d-c95c8cb95779', '4bd4e3f9-e0f9-4dd4-8ec6-685f742f0bca', '8b377761-1ad1-4c77-8fb2-b6556c83efcf', 'ba1ffe58-d3bd-4d4b-a913-bcad7356e5ce'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:59:05 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-47af1c9c-32d2-4260-a8ae-924089108aa3 tempest-GroupSnapshotsTest-249152645 None] group_snapshot 15e1d29d-c0cc-4e0f-bf47-fb57cdd5f2ef: deleted successfully Sep 17 14:59:05 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4" returned: 0 in 0.481s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:59:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e9f226-8803-4469-babe-b3d9fbf9e1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb2110f-e758-4984-8791-85761f5eec9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:05 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Volume volume-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4 (2f786ce3-2bd9-47bb-913e-0c6ca15b3df4): created successfully Sep 17 14:59:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb2110f-e758-4984-8791-85761f5eec9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Flow 'volume_create_manager' (134c2bfb-32a8-49b4-bd47-bae532e8eb5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:05 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-dcdf0cdc-333c-4bac-baab-ca056e511baa tempest-VolumesTestJSON-1490010891 None] Created volume successfully. Sep 17 14:59:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "cinder-quobyte-7349cfed-55b5-4fff-a48f-ed1beaa3427c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-7349cfed-55b5-4fff-a48f-ed1beaa3427c" acquired by "delete_volume" :: waited 0.029s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a08a0f3-b7da-4f9c-8ff0-67f0f2506b2e]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:06 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c Sep 17 14:59:06 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:07 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c" returned: 0 in 0.484s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:07 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c Sep 17 14:59:07 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Flow 'volume_create_manager' (60f02eb4-ab52-413a-b4c2-fe4629ed7d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c58700-889e-44aa-bf53-9101c59c5613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c58700-889e-44aa-bf53-9101c59c5613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-64414112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073e16eb-e1fc-45f8-ae4e-ad017e17e0c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b191d7032b8649f48e7306d108e8f7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:07Z,use_quota=True,user_id='c9b1996c1efe4604a519a1ba9c13bfa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb644d1-4bb4-414a-90cb-f69b77682d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb644d1-4bb4-414a-90cb-f69b77682d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dfc95eb-baa5-4c1a-b760-c8b8d087e888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dfc95eb-baa5-4c1a-b760-c8b8d087e888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '073e16eb-e1fc-45f8-ae4e-ad017e17e0c5', 'volume_name': 'volume-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56efbff7-0c3b-4b66-9ca8-3c8e5b1602c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56efbff7-0c3b-4b66-9ca8-3c8e5b1602c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94ecfbb-8bd1-4c05-bfeb-8fddafd2123a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:07 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Volume 073e16eb-e1fc-45f8-ae4e-ad017e17e0c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5', 'volume_size': 1} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-64414112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073e16eb-e1fc-45f8-ae4e-ad017e17e0c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b191d7032b8649f48e7306d108e8f7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:07Z,use_quota=True,user_id='c9b1996c1efe4604a519a1ba9c13bfa2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Creating volume 073e16eb-e1fc-45f8-ae4e-ad017e17e0c5 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:59:07 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:07 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7349cfed-55b5-4fff-a48f-ed1beaa3427c" returned: 0 in 0.323s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:07 devstack sudo[90004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5 1073741824 Sep 17 14:59:07 devstack sudo[90004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-7349cfed-55b5-4fff-a48f-ed1beaa3427c" released by "delete_volume" :: held 0.920s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "cinder-quobyte-b174fdfc-a42b-4382-b3b1-b59419d88277" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-b174fdfc-a42b-4382-b3b1-b59419d88277" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbba21db-c9c6-4769-a853-aa22e96cadca]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:07 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277 Sep 17 14:59:07 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:07 devstack sudo[90004]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5 1073741824" returned: 0 in 0.536s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:07 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277" returned: 0 in 0.410s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:07 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277 Sep 17 14:59:07 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:08 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5 Sep 17 14:59:08 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:08 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b174fdfc-a42b-4382-b3b1-b59419d88277" returned: 0 in 0.261s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-b174fdfc-a42b-4382-b3b1-b59419d88277" released by "delete_volume" :: held 0.747s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:08 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5" returned: 0 in 0.281s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94ecfbb-8bd1-4c05-bfeb-8fddafd2123a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c04d720-3aa0-463c-9647-0ee09fe69f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:08 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Volume volume-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5 (073e16eb-e1fc-45f8-ae4e-ad017e17e0c5): created successfully Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c04d720-3aa0-463c-9647-0ee09fe69f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Flow 'volume_create_manager' (60f02eb4-ab52-413a-b4c2-fe4629ed7d09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Created reservations ['ef56283c-c03d-4f1c-8ddd-d2238a759fb3'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:59:08 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7e87085b-79df-4971-88d4-292ab37783bb tempest-VolumesTestJSON-1490010891 None] Created volume successfully. Sep 17 14:59:08 devstack cinder-volume[86082]: WARNING cinder.quota [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-17449729 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-17449729, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Created reservations ['d9ff79f2-8c61-4d3c-bbf7-fc06e1374a54', '9aaca3cb-ee06-4e6c-8b04-7fd83a2898f6', '68a5ebaf-6286-415b-b371-5f152d793d15', '165586ab-020c-493b-a511-5f99cc549327'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Created reservations ['4689b8d0-a555-48fe-891a-2bfb97aaa12f', '80458578-60c9-4978-b956-008d39a10e7e', '778be372-a413-4989-a9b8-22759d0791f5', 'f5d3e974-2e17-4868-b1e1-a841a8e9cbcc'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:08 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:59:08 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:08 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.259s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:08 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:59:08 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-683475a5-20fe-47db-8890-a6212001cd3a tempest-GroupSnapshotsTest-249152645 None] Delete group completed successfully. Sep 17 14:59:09 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7b9f6b3a-dc8c-4b8d-b5d4-0aa48c956b70 tempest-GroupSnapshotsTest-249152645 None] Group tempest-GroupSnapshotsTest-Group-33315816: creating Sep 17 14:59:09 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7b9f6b3a-dc8c-4b8d-b5d4-0aa48c956b70 tempest-GroupSnapshotsTest-249152645 None] Group tempest-GroupSnapshotsTest-Group-33315816: created successfully Sep 17 14:59:09 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7b9f6b3a-dc8c-4b8d-b5d4-0aa48c956b70 tempest-GroupSnapshotsTest-249152645 None] Create group completed successfully. Sep 17 14:59:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] Acquiring lock "cinder-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] Lock "cinder-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] Acquiring lock "cinder-quobyte-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] Lock "cinder-quobyte-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:10 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b128725a-971c-4f83-bc1d-d095afa07937]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:10 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5 Sep 17 14:59:10 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:10 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5" returned: 0 in 0.487s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:10 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5 Sep 17 14:59:10 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Flow 'volume_create_manager' (1ae19748-bfb9-4eec-88b9-345e1ed0872f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af23cfb4-503e-4e75-8f5a-1c00c557dd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af23cfb4-503e-4e75-8f5a-1c00c557dd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1511037218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4eedd30-9fbf-42a0-904a-08795d7397b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d551293a1e480a8671a0bd9dc1e2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:11Z,use_quota=True,user_id='2df71feef87044eaac06c713cadc1257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5647c2d5-107f-4c2a-8fae-e137be280de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5647c2d5-107f-4c2a-8fae-e137be280de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0484db65-723c-431b-bb25-820e41b010b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:11 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5" returned: 0 in 0.362s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] Lock "cinder-quobyte-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5" released by "delete_volume" :: held 0.913s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Flow 'volume_create_manager' (58c1f1c8-8378-4c7c-8639-5251596c20e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9bed35-b52a-49e8-be4a-99e67b3f11f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9bed35-b52a-49e8-be4a-99e67b3f11f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-919746242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d7221189-f857-47be-80bb-67cf03cae414,host='devstack@QuobyteHD#QuobyteHD',id=c721d1f7-4227-4244-a1c9-fe2322f0f8f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc6177bcf5d4dd6a0027946da2d5a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:11Z,use_quota=True,user_id='ce20adb030c342d1b713d6f7ddc7d170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a83e859-9c0e-4472-a3ba-8e7dc9a46390),volume_type_id=0a83e859-9c0e-4472-a3ba-8e7dc9a46390)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557f2b83-0a87-4aa9-8cf8-5cc8721f1a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557f2b83-0a87-4aa9-8cf8-5cc8721f1a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0491b5-2988-4bfe-9296-f871ac031485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0491b5-2988-4bfe-9296-f871ac031485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c721d1f7-4227-4244-a1c9-fe2322f0f8f9', 'volume_name': 'volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7193ce23-c316-4637-86ab-aaec10f3deef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7193ce23-c316-4637-86ab-aaec10f3deef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03579ff0-ce0e-4909-9bf0-ffbd1bd22efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:11 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Volume c721d1f7-4227-4244-a1c9-fe2322f0f8f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9', 'volume_size': 1} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d7221189-f857-47be-80bb-67cf03cae414,created_at=2026-09-17T12:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-919746242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d7221189-f857-47be-80bb-67cf03cae414,host='devstack@QuobyteHD#QuobyteHD',id=c721d1f7-4227-4244-a1c9-fe2322f0f8f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc6177bcf5d4dd6a0027946da2d5a1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:11Z,use_quota=True,user_id='ce20adb030c342d1b713d6f7ddc7d170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a83e859-9c0e-4472-a3ba-8e7dc9a46390),volume_type_id=0a83e859-9c0e-4472-a3ba-8e7dc9a46390)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Creating volume c721d1f7-4227-4244-a1c9-fe2322f0f8f9 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:59:11 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] Created reservations ['9b0fd643-a53e-4862-9138-773a042a8ecb', '3e701818-7723-4a23-8ef6-7204ea2b4334', 'f3aa9d70-5dd7-482a-bc3b-8a2e5ee498f6', 'c9a058cb-d4b5-4935-b3e1-0ca526769355'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:59:11 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9 1073741824 Sep 17 14:59:11 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:11 devstack sudo[90037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:59:11 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0484db65-723c-431b-bb25-820e41b010b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a4eedd30-9fbf-42a0-904a-08795d7397b3', 'volume_name': 'volume-a4eedd30-9fbf-42a0-904a-08795d7397b3', 'volume_size': 1, 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a89aff0fcdbc4ac4a1aadbcc303a1058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd928b357-d516-479a-9030-78a0e857cb53', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d928b357-d516-479a-9030-78a0e857cb53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df0b974-be01-416f-a975-a6063f14d763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df0b974-be01-416f-a975-a6063f14d763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:11 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a572890b-2c24-47f6-b6ad-d35caee55109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:11 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Volume a4eedd30-9fbf-42a0-904a-08795d7397b3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a4eedd30-9fbf-42a0-904a-08795d7397b3', 'volume_size': 1, 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a89aff0fcdbc4ac4a1aadbcc303a1058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd928b357-d516-479a-9030-78a0e857cb53', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d928b357-d516-479a-9030-78a0e857cb53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Trying to clone a4eedd30-9fbf-42a0-904a-08795d7397b3 from image d928b357-d516-479a-9030-78a0e857cb53 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.305s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:59:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] Deleted volume successfully. Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-271b94c4-0a6d-4336-934d-29b18cf3dff4 tempest-VolumesTestJSON-1490010891 None] Lock "cinder-073e16eb-e1fc-45f8-ae4e-ad017e17e0c5-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:11 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9 1073741824" returned: 0 in 0.586s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:12 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9 Sep 17 14:59:12 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_fotp0qrfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 14:59:12 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Image download 20.69 MB at 20.69 MB/s Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2598ca64-f6ff-473d-a85c-4285baab6433]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_fotp0qrfdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:12 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9" returned: 0 in 0.262s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:12 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_fotp0qrfdevstack@QuobyteHD Sep 17 14:59:12 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03579ff0-ce0e-4909-9bf0-ffbd1bd22efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7290b4b-1b98-4b60-b66b-498d5a058e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:12 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Volume volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9 (c721d1f7-4227-4244-a1c9-fe2322f0f8f9): created successfully Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7290b4b-1b98-4b60-b66b-498d5a058e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Flow 'volume_create_manager' (58c1f1c8-8378-4c7c-8639-5251596c20e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:12 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2e75619b-a782-4e71-b878-62038b3203f1 tempest-GroupSnapshotsTest-249152645 None] Created volume successfully. Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] Acquiring lock "cinder-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] Lock "cinder-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:12 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_fotp0qrfdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Temporary image d928b357-d516-479a-9030-78a0e857cb53 is fetched for user 2df71feef87044eaac06c713cadc1257. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] Acquiring lock "cinder-quobyte-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] Lock "cinder-quobyte-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad5072c-8dfe-42af-98e3-902630b7e1ef]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46de68e-9797-4087-a692-7b0db295ac75]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_fotp0qrfdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:12 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4 Sep 17 14:59:12 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:12 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] GroupSnapshot 9feab568-e4d9-44d7-a46b-f27177211595: creating. Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] Group snapshot 9feab568-e4d9-44d7-a46b-f27177211595: creating. {{(pid=86082) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:12 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_fotp0qrfdevstack@QuobyteHD Sep 17 14:59:12 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] Creating offline snapshot e3dcab98-5189-4c66-9129-7702d4c6773a of volume c721d1f7-4227-4244-a1c9-fe2322f0f8f9 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4058880-fcb4-414d-ad04-25fe4c1dd330]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:12 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9 Sep 17 14:59:12 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:13 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4" returned: 0 in 0.435s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:13 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4 Sep 17 14:59:13 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:13 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_fotp0qrfdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:13 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9" returned: 0 in 0.393s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:13 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a 1G Sep 17 14:59:13 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:13 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4" returned: 0 in 0.277s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] Lock "cinder-quobyte-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4" released by "delete_volume" :: held 0.766s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] Created reservations ['e1b78326-b662-4a3c-9cf5-08db37f242bb', 'a297a786-c1ac-4efa-81ee-ee76e3e0ab97', '39406653-eaa3-4d01-96fd-f6e6e7130f04', 'ae7cdd91-39d6-4727-be96-eabcbc51e7ed'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:13 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:59:13 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:13 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a 1G" returned: 0 in 0.438s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] Acquiring lock "cinder-bed8f56e-ed91-4794-943a-6f0799abbdcd-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:13 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a Sep 17 14:59:13 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] Lock "cinder-bed8f56e-ed91-4794-943a-6f0799abbdcd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:13 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.281s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:59:13 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] Deleted volume successfully. Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] Acquiring lock "cinder-quobyte-bed8f56e-ed91-4794-943a-6f0799abbdcd" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c69db1be-dc82-41d4-b78f-88fd45e676a2 tempest-VolumesTestJSON-1490010891 None] Lock "cinder-2f786ce3-2bd9-47bb-913e-0c6ca15b3df4-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] Lock "cinder-quobyte-bed8f56e-ed91-4794-943a-6f0799abbdcd" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79324a7-0f3d-40c7-b673-c2021f4de107]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bed8f56e-ed91-4794-943a-6f0799abbdcd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:13 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bed8f56e-ed91-4794-943a-6f0799abbdcd Sep 17 14:59:13 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:13 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a" returned: 0 in 0.318s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:13 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a is being set with open permissions: ugo+rw: NotImplementedError Sep 17 14:59:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:14 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a Sep 17 14:59:14 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:14 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bed8f56e-ed91-4794-943a-6f0799abbdcd" returned: 0 in 0.373s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bed8f56e-ed91-4794-943a-6f0799abbdcd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:14 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bed8f56e-ed91-4794-943a-6f0799abbdcd Sep 17 14:59:14 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:14 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a" returned: 0 in 0.254s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:14 devstack sudo[90124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.info Sep 17 14:59:14 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:14 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bed8f56e-ed91-4794-943a-6f0799abbdcd" returned: 0 in 0.264s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] Lock "cinder-quobyte-bed8f56e-ed91-4794-943a-6f0799abbdcd" released by "delete_volume" :: held 0.688s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] Created reservations ['a2172cd8-f026-435d-ae8b-2e3ae64b0467', 'b56bd2ae-f1ce-4516-af63-d4162b6added', '939922ee-6e76-4914-b3fc-1bac4a88d805', 'ad67d8b3-c288-4539-9615-36f104d3fd81'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:59:14 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.info" returned: 0 in 0.263s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:14 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:14 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.info Sep 17 14:59:14 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:14 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:59:14 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:14 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.info" returned: 0 in 0.272s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.782s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1511037218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4eedd30-9fbf-42a0-904a-08795d7397b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d551293a1e480a8671a0bd9dc1e2ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:11Z,use_quota=True,user_id='2df71feef87044eaac06c713cadc1257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Creating volume a4eedd30-9fbf-42a0-904a-08795d7397b3 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:59:14 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:14 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3 1073741824 Sep 17 14:59:14 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:14 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.318s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:59:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] Deleted volume successfully. Sep 17 14:59:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-dcaeb860-06c2-4613-80c5-c22451e025a4 tempest-VolumesTestJSON-1490010891 None] Lock "cinder-bed8f56e-ed91-4794-943a-6f0799abbdcd-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b6e0a566-6a3b-4b28-abd1-477057ca0550 tempest-GroupSnapshotsTest-249152645 None] group_snapshot 9feab568-e4d9-44d7-a46b-f27177211595: created successfully Sep 17 14:59:15 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3 1073741824" returned: 0 in 0.576s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:15 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3 Sep 17 14:59:15 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:15 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3" returned: 0 in 0.287s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:59:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:15 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Attempting download of d928b357-d516-479a-9030-78a0e857cb53 ((None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}])) to volume a4eedd30-9fbf-42a0-904a-08795d7397b3. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 14:59:15 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f33d51-09d0-426f-925c-f92c5f36a85b]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_ch501x7u {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:16 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_ch501x7u Sep 17 14:59:16 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:16 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] group_snapshot 9feab568-e4d9-44d7-a46b-f27177211595: deleting Sep 17 14:59:16 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_ch501x7u" returned: 0 in 0.456s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_ch501x7u {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] group_snapshot 9feab568-e4d9-44d7-a46b-f27177211595: deleting {{(pid=86082) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 14:59:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "cinder-quobyte-c721d1f7-4227-4244-a1c9-fe2322f0f8f9" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-c721d1f7-4227-4244-a1c9-fe2322f0f8f9" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "cinder-quobyte-e3dcab98-5189-4c66-9129-7702d4c6773a" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-e3dcab98-5189-4c66-9129-7702d4c6773a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] Deleting offline snapshot e3dcab98-5189-4c66-9129-7702d4c6773a of volume c721d1f7-4227-4244-a1c9-fe2322f0f8f9 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 14:59:16 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_ch501x7u Sep 17 14:59:16 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] snapshot_file for this snap is: volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 14:59:16 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e26658-2b3b-43ac-8f53-44de3e1578b0]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:16 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a Sep 17 14:59:16 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:16 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_ch501x7u" returned: 1 in 0.472s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_ch501x7u' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 14:59:16 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a00e83-063e-491d-a364-79ec8ab5d4c0]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_fotp0qrfdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:16 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_fotp0qrfdevstack@QuobyteHD Sep 17 14:59:16 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:17 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a" returned: 0 in 0.552s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 14:59:17 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd42336-f3c0-43eb-8ea5-73042367cf07]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:17 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_fotp0qrfdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:17 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] d928b357-d516-479a-9030-78a0e857cb53 was qcow2, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 14:59:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_fotp0qrfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:17 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_fotp0qrfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3 Sep 17 14:59:17 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:17 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9 Sep 17 14:59:17 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:17 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9" returned: 0 in 0.480s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:17 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a Sep 17 14:59:17 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:18 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a" returned: 0 in 0.424s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:18 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a Sep 17 14:59:18 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:18 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9.e3dcab98-5189-4c66-9129-7702d4c6773a" returned: 0 in 0.326s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-e3dcab98-5189-4c66-9129-7702d4c6773a" released by "_delete_snapshot" :: held 1.980s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-c721d1f7-4227-4244-a1c9-fe2322f0f8f9" released by "delete_snapshot" :: held 2.011s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:18 devstack cinder-volume[86082]: WARNING cinder.quota [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-282250370 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-282250370, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:59:18 devstack cinder-volume[86082]: WARNING cinder.quota [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-282250370 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-282250370, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:59:18 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] Created reservations ['cb14a104-3c44-4eae-b0c2-f2eab2b04182', '7b0ea429-a7fb-4613-87f0-15351ab136bc', 'ac37a057-6d83-4fa6-b407-9b20dff8e4e1', '843967ff-cb35-439e-8750-2ca567066f46'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:59:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3ae56b82-11f1-49ed-81e6-7f6607f332d8 tempest-GroupSnapshotsTest-249152645 None] group_snapshot 9feab568-e4d9-44d7-a46b-f27177211595: deleted successfully Sep 17 14:59:20 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_fotp0qrfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3" returned: 0 in 2.982s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:20 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_fotp0qrfdevstack@QuobyteHD, size 112.00 MB, duration 2.98 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 14:59:20 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Converted 112.00 MB image at 37.54 MB/s Sep 17 14:59:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:20 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3 1G Sep 17 14:59:20 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "cinder-quobyte-c721d1f7-4227-4244-a1c9-fe2322f0f8f9" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-c721d1f7-4227-4244-a1c9-fe2322f0f8f9" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:20 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6014e0-3aa2-4002-8be3-244c3881a891]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:21 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3 1G" returned: 0 in 0.824s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:21 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Downloaded image d928b357-d516-479a-9030-78a0e857cb53 ((None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}])) to volume a4eedd30-9fbf-42a0-904a-08795d7397b3 successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 14:59:21 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Temporary image d928b357-d516-479a-9030-78a0e857cb53 for user 2df71feef87044eaac06c713cadc1257 is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 14:59:21 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Marking volume a4eedd30-9fbf-42a0-904a-08795d7397b3 as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 14:59:21 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9 Sep 17 14:59:21 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:21 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Copying metadata from image d928b357-d516-479a-9030-78a0e857cb53 to a4eedd30-9fbf-42a0-904a-08795d7397b3. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 14:59:21 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Creating volume glance metadata for volume a4eedd30-9fbf-42a0-904a-08795d7397b3 backed by image d928b357-d516-479a-9030-78a0e857cb53 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 14:59:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a572890b-2c24-47f6-b6ad-d35caee55109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4eedd30-9fbf-42a0-904a-08795d7397b3', 'volume_size': 1, 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a89aff0fcdbc4ac4a1aadbcc303a1058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd928b357-d516-479a-9030-78a0e857cb53', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d928b357-d516-479a-9030-78a0e857cb53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbab745-d8f3-4195-a7a7-5227869478a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:21 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Volume volume-a4eedd30-9fbf-42a0-904a-08795d7397b3 (a4eedd30-9fbf-42a0-904a-08795d7397b3): created successfully Sep 17 14:59:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbab745-d8f3-4195-a7a7-5227869478a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Flow 'volume_create_manager' (1ae19748-bfb9-4eec-88b9-345e1ed0872f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-24d24ecf-a67e-4587-8286-ae3776e2530c tempest-ServerActionsTestOtherA-1114292147 None] Created volume successfully. Sep 17 14:59:21 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9" returned: 0 in 0.695s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:21 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9 Sep 17 14:59:21 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:21 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c721d1f7-4227-4244-a1c9-fe2322f0f8f9" returned: 0 in 0.410s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] Lock "cinder-quobyte-c721d1f7-4227-4244-a1c9-fe2322f0f8f9" released by "delete_volume" :: held 1.246s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-059f3e55-f68c-49fb-a9a5-8efd88bdc7b1 tempest-GroupsV320Test-171081415 None] Group tempest-GroupsV320Test-Group-1586549494: creating Sep 17 14:59:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-059f3e55-f68c-49fb-a9a5-8efd88bdc7b1 tempest-GroupsV320Test-171081415 None] Group tempest-GroupsV320Test-Group-1586549494: created successfully Sep 17 14:59:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-059f3e55-f68c-49fb-a9a5-8efd88bdc7b1 tempest-GroupsV320Test-171081415 None] Create group completed successfully. Sep 17 14:59:22 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] Created reservations ['5b3eb20f-f82a-4752-86a9-5911a4126816'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:59:22 devstack cinder-volume[86082]: WARNING cinder.quota [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-282250370 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-282250370, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:59:22 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] Created reservations ['55fb858a-c8c9-4400-8551-dd06a162adf9', '724da0cf-9a0f-475f-aeba-467b85e2d61d', 'abd44e51-a877-408c-b92f-b85896010b52', '069c7532-1df9-46c6-adce-22290e6a6a8c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:59:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:22 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:59:22 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:22 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.376s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:22 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:59:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-60055659-aa40-454b-bbe1-36aee765a1e2 req-6a4e6a8b-653a-4199-afce-40c2b681f939 tempest-TaggedAttachmentsTest-1146269432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-60055659-aa40-454b-bbe1-36aee765a1e2 req-6a4e6a8b-653a-4199-afce-40c2b681f939 tempest-TaggedAttachmentsTest-1146269432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-557d86d6-7b96-4163-be15-e5d212616eba tempest-GroupSnapshotsTest-249152645 None] Delete group completed successfully. Sep 17 14:59:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-60055659-aa40-454b-bbe1-36aee765a1e2 req-6a4e6a8b-653a-4199-afce-40c2b681f939 tempest-TaggedAttachmentsTest-1146269432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-60055659-aa40-454b-bbe1-36aee765a1e2 req-6a4e6a8b-653a-4199-afce-40c2b681f939 tempest-TaggedAttachmentsTest-1146269432 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-63eeb2e2-3452-499c-b1f9-97e11f61531b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84a0a82f-7be6-449c-b254-a9dd0af00688', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 14:59:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-60055659-aa40-454b-bbe1-36aee765a1e2 req-6a4e6a8b-653a-4199-afce-40c2b681f939 tempest-TaggedAttachmentsTest-1146269432 None] attachment_update completed successfully. Sep 17 14:59:24 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-af9efac6-cc10-4a05-a025-57d35dd790d7 tempest-GroupsV320Test-171081415 None] Created reservations ['ad50a7ed-b9f0-487a-afad-8fa4987e2ece'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:59:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-af9efac6-cc10-4a05-a025-57d35dd790d7 tempest-GroupsV320Test-171081415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-af9efac6-cc10-4a05-a025-57d35dd790d7 tempest-GroupsV320Test-171081415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-af9efac6-cc10-4a05-a025-57d35dd790d7 tempest-GroupsV320Test-171081415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-af9efac6-cc10-4a05-a025-57d35dd790d7 tempest-GroupsV320Test-171081415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-af9efac6-cc10-4a05-a025-57d35dd790d7 tempest-GroupsV320Test-171081415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af9efac6-cc10-4a05-a025-57d35dd790d7 tempest-GroupsV320Test-171081415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:24 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:59:24 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:24 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af9efac6-cc10-4a05-a025-57d35dd790d7 tempest-GroupsV320Test-171081415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.281s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:24 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-af9efac6-cc10-4a05-a025-57d35dd790d7 tempest-GroupsV320Test-171081415 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:59:24 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-af9efac6-cc10-4a05-a025-57d35dd790d7 tempest-GroupsV320Test-171081415 None] Delete group completed successfully. Sep 17 14:59:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-a47c8107-2e27-43ca-908e-00b077596a4d req-0af6b805-d73a-41e9-af5e-f079ed02e7bb tempest-ServerActionsTestOtherA-1114292147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-a47c8107-2e27-43ca-908e-00b077596a4d req-0af6b805-d73a-41e9-af5e-f079ed02e7bb tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-a47c8107-2e27-43ca-908e-00b077596a4d req-0af6b805-d73a-41e9-af5e-f079ed02e7bb tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-a47c8107-2e27-43ca-908e-00b077596a4d req-0af6b805-d73a-41e9-af5e-f079ed02e7bb tempest-ServerActionsTestOtherA-1114292147 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-a4eedd30-9fbf-42a0-904a-08795d7397b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8d7efc3-b85f-40fb-8cd0-b38863a683ff', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 14:59:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-a47c8107-2e27-43ca-908e-00b077596a4d req-0af6b805-d73a-41e9-af5e-f079ed02e7bb tempest-ServerActionsTestOtherA-1114292147 None] attachment_update completed successfully. Sep 17 14:59:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-b57c9981-ed92-48e2-a8c8-4c40b9c10d13 req-11c14154-257d-4d2f-86ff-b8d4c0e3c7b0 tempest-TaggedAttachmentsTest-1146269432 None] Terminate volume connection completed successfully. Sep 17 14:59:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-b57c9981-ed92-48e2-a8c8-4c40b9c10d13 req-11c14154-257d-4d2f-86ff-b8d4c0e3c7b0 tempest-TaggedAttachmentsTest-1146269432 None] Deleting attachment 84a0a82f-7be6-449c-b254-a9dd0af00688. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 14:59:34 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3446a068-7dba-4804-af38-bce4364fdf69 tempest-GroupSnapshotsV319Test-910437786 None] Group tempest-GroupSnapshotsV319Test-Group-1375617078: creating Sep 17 14:59:34 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3446a068-7dba-4804-af38-bce4364fdf69 tempest-GroupSnapshotsV319Test-910437786 None] Group tempest-GroupSnapshotsV319Test-Group-1375617078: created successfully Sep 17 14:59:34 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3446a068-7dba-4804-af38-bce4364fdf69 tempest-GroupSnapshotsV319Test-910437786 None] Create group completed successfully. Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Flow 'volume_create_manager' (79be767b-9239-4e51-b02d-a2fbe3ebb29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d9cd50-adf0-4873-a4b9-1296c7804e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d9cd50-adf0-4873-a4b9-1296c7804e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-507382802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b373aeb-66b6-42bb-bd24-264fe6b83e7e,host='devstack@QuobyteHD#QuobyteHD',id=574dfa04-1cd6-4acf-ba64-999afc908067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df89677b39904bffb0cd2f0ad1facc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:36Z,use_quota=True,user_id='6024579ac701445ba5690de74c12514e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f13964-7348-43a5-b38b-57a47240b9c8),volume_type_id=00f13964-7348-43a5-b38b-57a47240b9c8)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e588f05-454f-4e47-b5d3-b7fe669009b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e588f05-454f-4e47-b5d3-b7fe669009b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf8770f-8e5a-48b6-b390-65afcd9f553f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf8770f-8e5a-48b6-b390-65afcd9f553f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '574dfa04-1cd6-4acf-ba64-999afc908067', 'volume_name': 'volume-574dfa04-1cd6-4acf-ba64-999afc908067', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e55906-12a0-4ad9-bb5e-61b0484160e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5e55906-12a0-4ad9-bb5e-61b0484160e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c28b62-a2db-4e33-8bc1-18a5f9ad98ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:36 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Volume 574dfa04-1cd6-4acf-ba64-999afc908067: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-574dfa04-1cd6-4acf-ba64-999afc908067', 'volume_size': 1} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7b373aeb-66b6-42bb-bd24-264fe6b83e7e,created_at=2026-09-17T12:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-507382802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b373aeb-66b6-42bb-bd24-264fe6b83e7e,host='devstack@QuobyteHD#QuobyteHD',id=574dfa04-1cd6-4acf-ba64-999afc908067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df89677b39904bffb0cd2f0ad1facc6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:36Z,use_quota=True,user_id='6024579ac701445ba5690de74c12514e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f13964-7348-43a5-b38b-57a47240b9c8),volume_type_id=00f13964-7348-43a5-b38b-57a47240b9c8)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Creating volume 574dfa04-1cd6-4acf-ba64-999afc908067 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:59:36 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 14:59:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:36 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067 1073741824 Sep 17 14:59:36 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:37 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067 1073741824" returned: 0 in 1.103s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:37 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067 Sep 17 14:59:37 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:38 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067" returned: 0 in 0.445s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:59:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c28b62-a2db-4e33-8bc1-18a5f9ad98ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-574dfa04-1cd6-4acf-ba64-999afc908067', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5ddfa5-9a60-4598-8c9e-ea064595722a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:38 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Volume volume-574dfa04-1cd6-4acf-ba64-999afc908067 (574dfa04-1cd6-4acf-ba64-999afc908067): created successfully Sep 17 14:59:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c5ddfa5-9a60-4598-8c9e-ea064595722a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Flow 'volume_create_manager' (79be767b-9239-4e51-b02d-a2fbe3ebb29c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:38 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-038137f7-30f8-49e2-90a7-6ec5581ed082 tempest-GroupSnapshotsV319Test-910437786 None] Created volume successfully. Sep 17 14:59:39 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] GroupSnapshot 0634dc9b-b949-4483-9a53-aa278b9baa4b: creating. Sep 17 14:59:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] Group snapshot 0634dc9b-b949-4483-9a53-aa278b9baa4b: creating. {{(pid=86082) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 14:59:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] Creating offline snapshot 232646f3-6e84-4daf-99f3-6571fa352e6e of volume 574dfa04-1cd6-4acf-ba64-999afc908067 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 14:59:39 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[131a0d80-d891-456e-a96c-5eef39e86f9d]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:39 devstack sudo[91251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067 Sep 17 14:59:39 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:40 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067" returned: 0 in 0.501s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:40 devstack sudo[91256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e 1G Sep 17 14:59:40 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:59:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:40 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:59:40 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:40 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e 1G" returned: 0 in 0.761s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574dfa04-1cd6-4acf-ba64-999afc908067 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:40 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574dfa04-1cd6-4acf-ba64-999afc908067 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e Sep 17 14:59:40 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:41 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.684s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:41 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:59:41 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-574dfa04-1cd6-4acf-ba64-999afc908067 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e" returned: 0 in 0.687s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:41 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e is being set with open permissions: ugo+rw: NotImplementedError Sep 17 14:59:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:41 devstack sudo[91271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e Sep 17 14:59:41 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:41 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e" returned: 0 in 0.357s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:41 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.info Sep 17 14:59:41 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:42 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.info" returned: 0 in 0.527s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:42 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 14:59:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:42 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.info Sep 17 14:59:42 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:42 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.info" returned: 0 in 0.526s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.558s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:43 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b462b016-636b-4eea-9f55-d5e9695cd7da tempest-GroupSnapshotsV319Test-910437786 None] group_snapshot 0634dc9b-b949-4483-9a53-aa278b9baa4b: created successfully Sep 17 14:59:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] Acquiring lock "cinder-63eeb2e2-3452-499c-b1f9-97e11f61531b-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] Lock "cinder-63eeb2e2-3452-499c-b1f9-97e11f61531b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] Acquiring lock "cinder-quobyte-63eeb2e2-3452-499c-b1f9-97e11f61531b" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] Lock "cinder-quobyte-63eeb2e2-3452-499c-b1f9-97e11f61531b" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9069014-7731-4f41-881f-fe4aeef24caf]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-63eeb2e2-3452-499c-b1f9-97e11f61531b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:43 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-63eeb2e2-3452-499c-b1f9-97e11f61531b Sep 17 14:59:43 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:43 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-63eeb2e2-3452-499c-b1f9-97e11f61531b" returned: 0 in 0.520s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-63eeb2e2-3452-499c-b1f9-97e11f61531b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:43 devstack sudo[91291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-63eeb2e2-3452-499c-b1f9-97e11f61531b Sep 17 14:59:43 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:44 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-63eeb2e2-3452-499c-b1f9-97e11f61531b" returned: 0 in 0.568s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] Lock "cinder-quobyte-63eeb2e2-3452-499c-b1f9-97e11f61531b" released by "delete_volume" :: held 1.213s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:44 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] Created reservations ['96288851-37f8-465d-81ca-0345def64113', '83e18905-5900-4dc2-8d2a-120035187862', '597d8eed-a4da-4f87-a3b6-8b71ca69e410', '0528aca9-b612-421a-9be7-aefc827394bb'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:59:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:44 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:59:44 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] group_snapshot 0634dc9b-b949-4483-9a53-aa278b9baa4b: deleting Sep 17 14:59:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] group_snapshot 0634dc9b-b949-4483-9a53-aa278b9baa4b: deleting {{(pid=86082) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 14:59:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] Acquiring lock "cinder-quobyte-574dfa04-1cd6-4acf-ba64-999afc908067" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:45 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.445s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:45 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:59:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] Deleted volume successfully. Sep 17 14:59:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] Lock "cinder-quobyte-574dfa04-1cd6-4acf-ba64-999afc908067" acquired by "delete_snapshot" :: waited 0.067s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] Acquiring lock "cinder-quobyte-232646f3-6e84-4daf-99f3-6571fa352e6e" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3aaf61f2-97a0-419a-8bee-911320286ec4 tempest-TaggedAttachmentsTest-1146269432 None] Lock "cinder-63eeb2e2-3452-499c-b1f9-97e11f61531b-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] Lock "cinder-quobyte-232646f3-6e84-4daf-99f3-6571fa352e6e" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] Deleting offline snapshot 232646f3-6e84-4daf-99f3-6571fa352e6e of volume 574dfa04-1cd6-4acf-ba64-999afc908067 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 14:59:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] snapshot_file for this snap is: volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 14:59:45 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e8ef58-83b6-424a-81df-d2131fe013d7]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:45 devstack sudo[91308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e Sep 17 14:59:45 devstack sudo[91308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:46 devstack sudo[91308]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e" returned: 0 in 0.696s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-574dfa04-1cd6-4acf-ba64-999afc908067(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 14:59:46 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[9791ac41-8d91-43c8-9e14-f6590a841d07]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:46 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067 Sep 17 14:59:46 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:46 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067" returned: 0 in 0.682s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:46 devstack sudo[91322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e Sep 17 14:59:46 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:47 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e" returned: 0 in 0.684s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:47 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e Sep 17 14:59:47 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:47 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067.232646f3-6e84-4daf-99f3-6571fa352e6e" returned: 0 in 0.533s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] Lock "cinder-quobyte-232646f3-6e84-4daf-99f3-6571fa352e6e" released by "_delete_snapshot" :: held 2.807s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:48 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-96e60d54-16e1-4e68-9a9e-c2bb3abecf54 req-4e5a4329-d01e-4dba-bd56-884420f10b4b tempest-ServerActionsTestOtherA-1114292147 None] Terminate volume connection completed successfully. Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-96e60d54-16e1-4e68-9a9e-c2bb3abecf54 req-4e5a4329-d01e-4dba-bd56-884420f10b4b tempest-ServerActionsTestOtherA-1114292147 None] Deleting attachment b8d7efc3-b85f-40fb-8cd0-b38863a683ff. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] Lock "cinder-quobyte-574dfa04-1cd6-4acf-ba64-999afc908067" released by "delete_snapshot" :: held 2.874s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:48 devstack cinder-volume[86082]: WARNING cinder.quota [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1723245407 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1723245407, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:59:48 devstack cinder-volume[86082]: WARNING cinder.quota [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1723245407 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1723245407, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] Created reservations ['b04558a3-d847-4eb7-9aa7-5bd86ca8edf1', 'b73026cb-dc33-4e05-af8d-aafb3854bd2b', 'c7a59fb0-500a-46cc-9286-e9c91447d7d4', 'a33edca6-549f-43df-a625-9e6abb90c211'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:59:48 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-cf5b2fce-4640-4510-ab70-fb7c83b496b1 tempest-GroupSnapshotsV319Test-910437786 None] group_snapshot 0634dc9b-b949-4483-9a53-aa278b9baa4b: deleted successfully Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Flow 'volume_create_manager' (ddd7e15b-486e-4d79-bdf8-5a993e30cdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35830eed-1872-40fb-98c5-9beee79ccd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35830eed-1872-40fb-98c5-9beee79ccd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-120760851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98cda758-f21c-4509-93d1-61f948f5319b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae661be5f0a54bc19459bf1084a9ca51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:48Z,use_quota=True,user_id='cddbfba24f59476cb0daa3d7af2aafd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3d525f2-b4e6-4f56-b952-cbae05891d0f),volume_type_id=f3d525f2-b4e6-4f56-b952-cbae05891d0f)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a17169a-94f4-41b2-8a2f-401100dd567c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a17169a-94f4-41b2-8a2f-401100dd567c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d34228-5d30-4c37-b45a-b624cca3c183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d34228-5d30-4c37-b45a-b624cca3c183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98cda758-f21c-4509-93d1-61f948f5319b', 'volume_name': 'volume-98cda758-f21c-4509-93d1-61f948f5319b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b07ee7-b988-4740-a6b9-1e4e8bb572a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b07ee7-b988-4740-a6b9-1e4e8bb572a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce0e733-242f-4c6a-b400-bf90394fdf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:48 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Volume 98cda758-f21c-4509-93d1-61f948f5319b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98cda758-f21c-4509-93d1-61f948f5319b', 'volume_size': 1} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-120760851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98cda758-f21c-4509-93d1-61f948f5319b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae661be5f0a54bc19459bf1084a9ca51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:48Z,use_quota=True,user_id='cddbfba24f59476cb0daa3d7af2aafd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3d525f2-b4e6-4f56-b952-cbae05891d0f),volume_type_id=f3d525f2-b4e6-4f56-b952-cbae05891d0f)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Creating volume 98cda758-f21c-4509-93d1-61f948f5319b {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:59:48 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 14:59:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-98cda758-f21c-4509-93d1-61f948f5319b 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:48 devstack sudo[91380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-98cda758-f21c-4509-93d1-61f948f5319b 1073741824 Sep 17 14:59:48 devstack sudo[91380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] Acquiring lock "cinder-quobyte-574dfa04-1cd6-4acf-ba64-999afc908067" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] Lock "cinder-quobyte-574dfa04-1cd6-4acf-ba64-999afc908067" acquired by "delete_volume" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:49 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0e5769-0d52-4273-b60a-6f5dbe520cbd]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:49 devstack sudo[91380]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-98cda758-f21c-4509-93d1-61f948f5319b 1073741824" returned: 0 in 0.721s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-98cda758-f21c-4509-93d1-61f948f5319b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:49 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-98cda758-f21c-4509-93d1-61f948f5319b Sep 17 14:59:49 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:49 devstack sudo[91388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067 Sep 17 14:59:49 devstack sudo[91388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:49 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-98cda758-f21c-4509-93d1-61f948f5319b" returned: 0 in 0.287s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:59:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce0e733-242f-4c6a-b400-bf90394fdf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98cda758-f21c-4509-93d1-61f948f5319b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3008b7-16fc-4ac4-b504-3555dc1b1050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:49 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Volume volume-98cda758-f21c-4509-93d1-61f948f5319b (98cda758-f21c-4509-93d1-61f948f5319b): created successfully Sep 17 14:59:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3008b7-16fc-4ac4-b504-3555dc1b1050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Flow 'volume_create_manager' (ddd7e15b-486e-4d79-bdf8-5a993e30cdac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:49 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f524b282-d3dc-4adb-992c-a160738aeab0 tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Created volume successfully. Sep 17 14:59:49 devstack sudo[91388]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067" returned: 0 in 0.499s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:49 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067 Sep 17 14:59:49 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:50 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-574dfa04-1cd6-4acf-ba64-999afc908067" returned: 0 in 0.300s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] Lock "cinder-quobyte-574dfa04-1cd6-4acf-ba64-999afc908067" released by "delete_volume" :: held 0.902s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-96e60d54-16e1-4e68-9a9e-c2bb3abecf54 req-840ced48-113e-4ecd-8d55-8ec35bb25caa tempest-ServerActionsTestOtherA-1114292147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-96e60d54-16e1-4e68-9a9e-c2bb3abecf54 req-840ced48-113e-4ecd-8d55-8ec35bb25caa tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:50 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] Created reservations ['68ec3702-f7d7-4714-a5d3-93ccd9a75c35'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:59:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-96e60d54-16e1-4e68-9a9e-c2bb3abecf54 req-840ced48-113e-4ecd-8d55-8ec35bb25caa tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:50 devstack cinder-volume[86082]: WARNING cinder.quota [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1723245407 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1723245407, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:59:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-96e60d54-16e1-4e68-9a9e-c2bb3abecf54 req-840ced48-113e-4ecd-8d55-8ec35bb25caa tempest-ServerActionsTestOtherA-1114292147 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-a4eedd30-9fbf-42a0-904a-08795d7397b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09de6915-362b-47e6-8051-a9351d14e902', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 14:59:50 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] Created reservations ['877bc372-05ad-452b-aaee-a2233c176f73', 'e76a1a73-4bfd-4030-a9f5-ff88b0ee6b07', '596fdf33-73c3-4525-a11a-72c364dc1461', '6d83da94-ae43-4364-bb8b-993022fc25e4'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:59:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-96e60d54-16e1-4e68-9a9e-c2bb3abecf54 req-840ced48-113e-4ecd-8d55-8ec35bb25caa tempest-ServerActionsTestOtherA-1114292147 None] attachment_update completed successfully. Sep 17 14:59:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:50 devstack sudo[91407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:59:50 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:50 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.290s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:50 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:59:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fd5c0ad2-3a48-48a7-8395-a82956e4879e tempest-GroupSnapshotsV319Test-910437786 None] Delete group completed successfully. Sep 17 14:59:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5610e5eb-23cb-4728-ad65-43ec0eb9615c tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5610e5eb-23cb-4728-ad65-43ec0eb9615c tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5610e5eb-23cb-4728-ad65-43ec0eb9615c tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5610e5eb-23cb-4728-ad65-43ec0eb9615c tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5610e5eb-23cb-4728-ad65-43ec0eb9615c tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5610e5eb-23cb-4728-ad65-43ec0eb9615c tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:51 devstack sudo[91519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:59:51 devstack sudo[91519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:51 devstack sudo[91519]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5610e5eb-23cb-4728-ad65-43ec0eb9615c tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.516s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:51 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-5610e5eb-23cb-4728-ad65-43ec0eb9615c tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:59:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5610e5eb-23cb-4728-ad65-43ec0eb9615c tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Retype volume completed successfully. Sep 17 14:59:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Acquiring lock "cinder-98cda758-f21c-4509-93d1-61f948f5319b-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Lock "cinder-98cda758-f21c-4509-93d1-61f948f5319b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Acquiring lock "cinder-quobyte-98cda758-f21c-4509-93d1-61f948f5319b" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:59:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Lock "cinder-quobyte-98cda758-f21c-4509-93d1-61f948f5319b" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:59:52 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9f64b8-a520-485e-bfda-d191d6fbb030]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:59:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-98cda758-f21c-4509-93d1-61f948f5319b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:52 devstack sudo[91862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-98cda758-f21c-4509-93d1-61f948f5319b Sep 17 14:59:52 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:53 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-98cda758-f21c-4509-93d1-61f948f5319b" returned: 0 in 0.696s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-98cda758-f21c-4509-93d1-61f948f5319b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:53 devstack sudo[91872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-98cda758-f21c-4509-93d1-61f948f5319b Sep 17 14:59:53 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:53 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-98cda758-f21c-4509-93d1-61f948f5319b" returned: 0 in 0.446s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Lock "cinder-quobyte-98cda758-f21c-4509-93d1-61f948f5319b" released by "delete_volume" :: held 1.210s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:59:53 devstack cinder-volume[86082]: WARNING cinder.quota [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:59:53 devstack cinder-volume[86082]: WARNING cinder.quota [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:59:53 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Created reservations ['40cf762b-e658-4071-aded-bebeb9406ba4', '4cacdebf-0d51-4c04-bce5-e08e924e3c1f', '6e10e441-33dc-4037-bb83-6622126b2c10', '5fd8ab23-3d31-4874-b093-93271eb6bfa5'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:59:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:53 devstack sudo[91875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 14:59:53 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:54 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.314s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:54 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:59:54 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Deleted volume successfully. Sep 17 14:59:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ccdd9c0e-635f-4e76-8884-7af4baa1d55f tempest-VolumeRetypeWithoutMigrationTest-2087714750 None] Lock "cinder-98cda758-f21c-4509-93d1-61f948f5319b-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:00:03 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=155,cinder:UPDATE=152,cinder:INSERT=37,cinder:DELETE=5 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:00:04 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=147,cinder:SELECT=159,cinder:INSERT=42,cinder:DELETE=7 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:00:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-de493048-9764-4961-8eee-e99edd743776 tempest-GroupsTest-1491513031 None] Group tempest-Group1-440344747: creating Sep 17 15:00:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-de493048-9764-4961-8eee-e99edd743776 tempest-GroupsTest-1491513031 None] Group tempest-Group1-440344747: created successfully Sep 17 15:00:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-de493048-9764-4961-8eee-e99edd743776 tempest-GroupsTest-1491513031 None] Create group completed successfully. Sep 17 15:00:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a513d7cb-4735-48b1-8fee-dae631dcfbb4 tempest-GroupsTest-1491513031 None] Group tempest-Group2-952089482: creating Sep 17 15:00:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a513d7cb-4735-48b1-8fee-dae631dcfbb4 tempest-GroupsTest-1491513031 None] Group tempest-Group2-952089482: created successfully Sep 17 15:00:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a513d7cb-4735-48b1-8fee-dae631dcfbb4 tempest-GroupsTest-1491513031 None] Create group completed successfully. Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Flow 'volume_create_manager' (36474537-b7c6-4950-bc6a-51b91a7f780a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18d1ff1-473c-40e0-94eb-0e341b3e9e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18d1ff1-473c-40e0-94eb-0e341b3e9e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-904668127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0719a697-54a7-4ec4-8422-32b0cc483fbb,host='devstack@QuobyteHD#QuobyteHD',id=6b9a3970-a518-40b2-b7bc-21417c3645ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92622dd37d5d44c6825f1b3a41ccb59c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:13Z,use_quota=True,user_id='9052bbe3b0914a52b0205410c6753a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a58acff-346f-4a1f-8fef-9487bb68fea9),volume_type_id=4a58acff-346f-4a1f-8fef-9487bb68fea9)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56289c65-099a-40f7-a8be-345304c3e1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56289c65-099a-40f7-a8be-345304c3e1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0d7f82-938a-4101-a00d-aa98815e8a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0d7f82-938a-4101-a00d-aa98815e8a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b9a3970-a518-40b2-b7bc-21417c3645ca', 'volume_name': 'volume-6b9a3970-a518-40b2-b7bc-21417c3645ca', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0b2104-c047-466e-96ae-c7b86c39ef58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0b2104-c047-466e-96ae-c7b86c39ef58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274f3b12-39ca-4659-8b3d-f066458ad1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:13 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Volume 6b9a3970-a518-40b2-b7bc-21417c3645ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b9a3970-a518-40b2-b7bc-21417c3645ca', 'volume_size': 1} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0719a697-54a7-4ec4-8422-32b0cc483fbb,created_at=2026-09-17T13:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-904668127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0719a697-54a7-4ec4-8422-32b0cc483fbb,host='devstack@QuobyteHD#QuobyteHD',id=6b9a3970-a518-40b2-b7bc-21417c3645ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92622dd37d5d44c6825f1b3a41ccb59c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:13Z,use_quota=True,user_id='9052bbe3b0914a52b0205410c6753a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a58acff-346f-4a1f-8fef-9487bb68fea9),volume_type_id=4a58acff-346f-4a1f-8fef-9487bb68fea9)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Creating volume 6b9a3970-a518-40b2-b7bc-21417c3645ca {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:00:13 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6b9a3970-a518-40b2-b7bc-21417c3645ca 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:13 devstack sudo[91967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6b9a3970-a518-40b2-b7bc-21417c3645ca 1073741824 Sep 17 15:00:13 devstack sudo[91967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:13 devstack sudo[91967]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6b9a3970-a518-40b2-b7bc-21417c3645ca 1073741824" returned: 0 in 0.540s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6b9a3970-a518-40b2-b7bc-21417c3645ca {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:14 devstack sudo[91980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6b9a3970-a518-40b2-b7bc-21417c3645ca Sep 17 15:00:14 devstack sudo[91980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Flow 'volume_create_manager' (4823b691-4667-472c-a1de-0b16277089a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4d885e-4050-4dc6-8dd9-b3f24466f0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4d885e-4050-4dc6-8dd9-b3f24466f0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-524226746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f76c8ff-90a2-4035-8028-00211faff1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f1e8263f9a4f6ab8f7e30e08e03089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:14Z,use_quota=True,user_id='5cafccb681ea425a868c6d4a4f66374f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36454117-a24b-447b-99b3-c11f42e3dda6),volume_type_id=36454117-a24b-447b-99b3-c11f42e3dda6)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d2b205-fb45-4f4b-b14a-89528cb78838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77d2b205-fb45-4f4b-b14a-89528cb78838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0195f22d-cceb-4541-b2f7-aca756bf3247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0195f22d-cceb-4541-b2f7-aca756bf3247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f76c8ff-90a2-4035-8028-00211faff1eb', 'volume_name': 'volume-0f76c8ff-90a2-4035-8028-00211faff1eb', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f87343-e90f-413c-a58e-dcde6b55b5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f87343-e90f-413c-a58e-dcde6b55b5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6605246-989b-48a4-82a3-bd6d6f86046e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:14 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Volume 0f76c8ff-90a2-4035-8028-00211faff1eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f76c8ff-90a2-4035-8028-00211faff1eb', 'volume_size': 1} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:14 devstack sudo[91980]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6b9a3970-a518-40b2-b7bc-21417c3645ca" returned: 0 in 0.278s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.118s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-524226746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f76c8ff-90a2-4035-8028-00211faff1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f1e8263f9a4f6ab8f7e30e08e03089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:14Z,use_quota=True,user_id='5cafccb681ea425a868c6d4a4f66374f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36454117-a24b-447b-99b3-c11f42e3dda6),volume_type_id=36454117-a24b-447b-99b3-c11f42e3dda6)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Creating volume 0f76c8ff-90a2-4035-8028-00211faff1eb {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:00:14 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0f76c8ff-90a2-4035-8028-00211faff1eb 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274f3b12-39ca-4659-8b3d-f066458ad1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9a3970-a518-40b2-b7bc-21417c3645ca', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:14 devstack sudo[91983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0f76c8ff-90a2-4035-8028-00211faff1eb 1073741824 Sep 17 15:00:14 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e44ba62-74e2-458a-ab04-36833aa5dd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:14 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Volume volume-6b9a3970-a518-40b2-b7bc-21417c3645ca (6b9a3970-a518-40b2-b7bc-21417c3645ca): created successfully Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e44ba62-74e2-458a-ab04-36833aa5dd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Flow 'volume_create_manager' (36474537-b7c6-4950-bc6a-51b91a7f780a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-22d69016-079e-4b99-98da-844a93f88574 tempest-GroupsTest-1491513031 None] Created volume successfully. Sep 17 15:00:14 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0f76c8ff-90a2-4035-8028-00211faff1eb 1073741824" returned: 0 in 0.666s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0f76c8ff-90a2-4035-8028-00211faff1eb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:15 devstack sudo[91989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0f76c8ff-90a2-4035-8028-00211faff1eb Sep 17 15:00:15 devstack sudo[91989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] Acquiring lock "cinder-quobyte-6b9a3970-a518-40b2-b7bc-21417c3645ca" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:00:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] Lock "cinder-quobyte-6b9a3970-a518-40b2-b7bc-21417c3645ca" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:00:15 devstack sudo[91989]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0f76c8ff-90a2-4035-8028-00211faff1eb" returned: 0 in 0.315s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:00:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6605246-989b-48a4-82a3-bd6d6f86046e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f76c8ff-90a2-4035-8028-00211faff1eb', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5af900e-6313-4964-8b7b-1444fc6e0e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:15 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e56221f-e785-4f62-90fb-898b28be8c17]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6b9a3970-a518-40b2-b7bc-21417c3645ca {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:15 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Volume volume-0f76c8ff-90a2-4035-8028-00211faff1eb (0f76c8ff-90a2-4035-8028-00211faff1eb): created successfully Sep 17 15:00:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5af900e-6313-4964-8b7b-1444fc6e0e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Flow 'volume_create_manager' (4823b691-4667-472c-a1de-0b16277089a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8abbb134-3616-4891-a67f-704adaee27a0 tempest-VolumeTypesAccessTest-1790784572 None] Created volume successfully. Sep 17 15:00:15 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6b9a3970-a518-40b2-b7bc-21417c3645ca Sep 17 15:00:15 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:15 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6b9a3970-a518-40b2-b7bc-21417c3645ca" returned: 0 in 0.423s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6b9a3970-a518-40b2-b7bc-21417c3645ca {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:15 devstack sudo[91997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6b9a3970-a518-40b2-b7bc-21417c3645ca Sep 17 15:00:15 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:16 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6b9a3970-a518-40b2-b7bc-21417c3645ca" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] Lock "cinder-quobyte-6b9a3970-a518-40b2-b7bc-21417c3645ca" released by "delete_volume" :: held 0.763s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] Created reservations ['4575c931-f8a7-4eba-922a-fd39a69e8db1'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:00:16 devstack cinder-volume[86082]: WARNING cinder.quota [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1529631260 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1529631260, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:00:16 devstack cinder-volume[86082]: WARNING cinder.quota [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1529631260 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1529631260, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] Created reservations ['61c1a42d-ed7e-4b2d-ac98-4485433bfcdd', 'dd6bf180-7982-461a-abda-8157328a6e74', '2224d863-e610-43ad-b04a-281182555a96', '5f6d4441-29dc-4d30-b441-bba1f43ea0ed'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Acquiring lock "cinder-0f76c8ff-90a2-4035-8028-00211faff1eb-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Lock "cinder-0f76c8ff-90a2-4035-8028-00211faff1eb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Acquiring lock "cinder-quobyte-0f76c8ff-90a2-4035-8028-00211faff1eb" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Lock "cinder-quobyte-0f76c8ff-90a2-4035-8028-00211faff1eb" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec9a9f7-051d-4144-91bf-44c30fbf8675]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0f76c8ff-90a2-4035-8028-00211faff1eb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:16 devstack sudo[92001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:00:16 devstack sudo[92001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:16 devstack sudo[92000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0f76c8ff-90a2-4035-8028-00211faff1eb Sep 17 15:00:16 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-2132309a-ccf0-44c2-a945-569f712af52f tempest-GroupsTest-1491513031 None] Created reservations ['89c010a7-c08e-4215-9805-bc682b2e51ce'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2132309a-ccf0-44c2-a945-569f712af52f tempest-GroupsTest-1491513031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2132309a-ccf0-44c2-a945-569f712af52f tempest-GroupsTest-1491513031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2132309a-ccf0-44c2-a945-569f712af52f tempest-GroupsTest-1491513031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2132309a-ccf0-44c2-a945-569f712af52f tempest-GroupsTest-1491513031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2132309a-ccf0-44c2-a945-569f712af52f tempest-GroupsTest-1491513031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2132309a-ccf0-44c2-a945-569f712af52f tempest-GroupsTest-1491513031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:16 devstack sudo[92006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:00:16 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:16 devstack sudo[92001]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.525s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:16 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0f76c8ff-90a2-4035-8028-00211faff1eb" returned: 0 in 0.590s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0f76c8ff-90a2-4035-8028-00211faff1eb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:16 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a67ded06-9a74-447f-b7a5-9d659a205058 tempest-GroupsTest-1491513031 None] Delete group completed successfully. Sep 17 15:00:16 devstack sudo[92010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0f76c8ff-90a2-4035-8028-00211faff1eb Sep 17 15:00:16 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:17 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2132309a-ccf0-44c2-a945-569f712af52f tempest-GroupsTest-1491513031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.299s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:17 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-2132309a-ccf0-44c2-a945-569f712af52f tempest-GroupsTest-1491513031 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:00:17 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2132309a-ccf0-44c2-a945-569f712af52f tempest-GroupsTest-1491513031 None] Delete group completed successfully. Sep 17 15:00:17 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0f76c8ff-90a2-4035-8028-00211faff1eb" returned: 0 in 0.291s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Lock "cinder-quobyte-0f76c8ff-90a2-4035-8028-00211faff1eb" released by "delete_volume" :: held 0.947s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:00:17 devstack cinder-volume[86082]: WARNING cinder.quota [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1387536496 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1387536496, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:00:17 devstack cinder-volume[86082]: WARNING cinder.quota [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1387536496 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1387536496, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:00:17 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Created reservations ['df17a4f3-34df-4677-a78f-430c46abb207', 'f76f116b-ccb1-48c5-9954-350394ab9832', 'bedc051f-fed6-4560-97b8-e9a4361a62e8', 'a26a5179-9189-4980-831b-87d737638428'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:00:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:17 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:00:17 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:17 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.333s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:17 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:00:17 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Deleted volume successfully. Sep 17 15:00:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3d89ca1f-2ffc-4c8a-ae71-5e581d82bcdb tempest-VolumeTypesAccessTest-1790784572 None] Lock "cinder-0f76c8ff-90a2-4035-8028-00211faff1eb-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:00:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-16da18ff-a1df-4e64-a344-d7415d87e708 tempest-GroupsTest-1491513031 None] Group tempest-GroupsTest-Group-146072134: creating Sep 17 15:00:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-16da18ff-a1df-4e64-a344-d7415d87e708 tempest-GroupsTest-1491513031 None] Group tempest-GroupsTest-Group-146072134: created successfully Sep 17 15:00:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-16da18ff-a1df-4e64-a344-d7415d87e708 tempest-GroupsTest-1491513031 None] Create group completed successfully. Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Flow 'volume_create_manager' (520f0b65-e151-4d7d-94cf-47626b9516f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d8ed41-5ecc-4019-bfdb-0f6ef4f53f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6d8ed41-5ecc-4019-bfdb-0f6ef4f53f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1200474184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=32449e15-d704-45fb-8c83-7df9903a323e,host='devstack@QuobyteHD#QuobyteHD',id=25f26f46-eeed-4b98-96a3-091b85f02d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92622dd37d5d44c6825f1b3a41ccb59c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:20Z,use_quota=True,user_id='9052bbe3b0914a52b0205410c6753a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7ca6f97-5a27-4934-ad51-0a5ee91785df),volume_type_id=e7ca6f97-5a27-4934-ad51-0a5ee91785df)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a3fcf9-7cb9-49d0-8441-e4ef280663de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a3fcf9-7cb9-49d0-8441-e4ef280663de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16bc72c-3dc2-40ef-b594-e1e20b22cb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16bc72c-3dc2-40ef-b594-e1e20b22cb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f26f46-eeed-4b98-96a3-091b85f02d8e', 'volume_name': 'volume-25f26f46-eeed-4b98-96a3-091b85f02d8e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f01897-c006-435e-bc3d-8ff004ba6b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f01897-c006-435e-bc3d-8ff004ba6b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f15eb591-fba8-447a-9959-1118e4c6c7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:20 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Volume 25f26f46-eeed-4b98-96a3-091b85f02d8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f26f46-eeed-4b98-96a3-091b85f02d8e', 'volume_size': 1} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=32449e15-d704-45fb-8c83-7df9903a323e,created_at=2026-09-17T13:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1200474184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=32449e15-d704-45fb-8c83-7df9903a323e,host='devstack@QuobyteHD#QuobyteHD',id=25f26f46-eeed-4b98-96a3-091b85f02d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92622dd37d5d44c6825f1b3a41ccb59c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:20Z,use_quota=True,user_id='9052bbe3b0914a52b0205410c6753a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7ca6f97-5a27-4934-ad51-0a5ee91785df),volume_type_id=e7ca6f97-5a27-4934-ad51-0a5ee91785df)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Creating volume 25f26f46-eeed-4b98-96a3-091b85f02d8e {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:00:20 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:00:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-25f26f46-eeed-4b98-96a3-091b85f02d8e 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:20 devstack sudo[92023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-25f26f46-eeed-4b98-96a3-091b85f02d8e 1073741824 Sep 17 15:00:20 devstack sudo[92023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:21 devstack sudo[92023]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-25f26f46-eeed-4b98-96a3-091b85f02d8e 1073741824" returned: 0 in 0.704s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-25f26f46-eeed-4b98-96a3-091b85f02d8e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:21 devstack sudo[92036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-25f26f46-eeed-4b98-96a3-091b85f02d8e Sep 17 15:00:21 devstack sudo[92036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:21 devstack sudo[92036]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-25f26f46-eeed-4b98-96a3-091b85f02d8e" returned: 0 in 0.503s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:00:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f15eb591-fba8-447a-9959-1118e4c6c7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f26f46-eeed-4b98-96a3-091b85f02d8e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b2898a-dcf1-4fb8-9e43-4893044a2e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:21 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Volume volume-25f26f46-eeed-4b98-96a3-091b85f02d8e (25f26f46-eeed-4b98-96a3-091b85f02d8e): created successfully Sep 17 15:00:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b2898a-dcf1-4fb8-9e43-4893044a2e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Flow 'volume_create_manager' (520f0b65-e151-4d7d-94cf-47626b9516f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-21f6acf8-844b-4ce8-ae6b-126a6a4d99fa tempest-GroupsTest-1491513031 None] Created volume successfully. Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Flow 'volume_create_manager' (35aba29a-a665-4c58-82b6-fa232499d4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dad412a-6f67-4360-a6b9-044dfe4f4192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dad412a-6f67-4360-a6b9-044dfe4f4192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-920186735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=32449e15-d704-45fb-8c83-7df9903a323e,host='devstack@QuobyteHD#QuobyteHD',id=6ccf6177-4411-4ecf-80f7-8861a451d4ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92622dd37d5d44c6825f1b3a41ccb59c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:24Z,use_quota=True,user_id='9052bbe3b0914a52b0205410c6753a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7ca6f97-5a27-4934-ad51-0a5ee91785df),volume_type_id=e7ca6f97-5a27-4934-ad51-0a5ee91785df)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3bd655-ab6f-4d53-baeb-0abbf43ba1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3bd655-ab6f-4d53-baeb-0abbf43ba1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813796ef-e6c2-46dd-9828-c011c7fba570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (813796ef-e6c2-46dd-9828-c011c7fba570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ccf6177-4411-4ecf-80f7-8861a451d4ef', 'volume_name': 'volume-6ccf6177-4411-4ecf-80f7-8861a451d4ef', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3224cc-0984-4525-b8f7-28920a26de53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3224cc-0984-4525-b8f7-28920a26de53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a041ad-bece-466b-b6e2-7a2ceaa61c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:23 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Volume 6ccf6177-4411-4ecf-80f7-8861a451d4ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ccf6177-4411-4ecf-80f7-8861a451d4ef', 'volume_size': 1} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=32449e15-d704-45fb-8c83-7df9903a323e,created_at=2026-09-17T13:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-920186735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=32449e15-d704-45fb-8c83-7df9903a323e,host='devstack@QuobyteHD#QuobyteHD',id=6ccf6177-4411-4ecf-80f7-8861a451d4ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92622dd37d5d44c6825f1b3a41ccb59c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:24Z,use_quota=True,user_id='9052bbe3b0914a52b0205410c6753a32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7ca6f97-5a27-4934-ad51-0a5ee91785df),volume_type_id=e7ca6f97-5a27-4934-ad51-0a5ee91785df)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Creating volume 6ccf6177-4411-4ecf-80f7-8861a451d4ef {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:00:23 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:00:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6ccf6177-4411-4ecf-80f7-8861a451d4ef 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:23 devstack sudo[92057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6ccf6177-4411-4ecf-80f7-8861a451d4ef 1073741824 Sep 17 15:00:23 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:24 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6ccf6177-4411-4ecf-80f7-8861a451d4ef 1073741824" returned: 0 in 0.697s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6ccf6177-4411-4ecf-80f7-8861a451d4ef {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:24 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6ccf6177-4411-4ecf-80f7-8861a451d4ef Sep 17 15:00:24 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:25 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6ccf6177-4411-4ecf-80f7-8861a451d4ef" returned: 0 in 0.494s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:00:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a041ad-bece-466b-b6e2-7a2ceaa61c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ccf6177-4411-4ecf-80f7-8861a451d4ef', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3fea931-d7d8-4518-aa38-2debfdc55bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:25 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Volume volume-6ccf6177-4411-4ecf-80f7-8861a451d4ef (6ccf6177-4411-4ecf-80f7-8861a451d4ef): created successfully Sep 17 15:00:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3fea931-d7d8-4518-aa38-2debfdc55bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Flow 'volume_create_manager' (35aba29a-a665-4c58-82b6-fa232499d4a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f4f8763d-7e29-4073-ba96-d42ae13f77b4 tempest-GroupsTest-1491513031 None] Created volume successfully. Sep 17 15:00:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ed198aec-c534-49b8-babb-d1b9778177a3 tempest-GroupsTest-1491513031 None] Update group completed successfully. Sep 17 15:00:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-8e3e2fc3-69a6-43fc-8b9f-8a3f9122945a tempest-ServerActionsTestOtherA-1114292147 None] Terminate volume connection completed successfully. Sep 17 15:00:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-8e3e2fc3-69a6-43fc-8b9f-8a3f9122945a tempest-ServerActionsTestOtherA-1114292147 None] Deleting attachment 09de6915-362b-47e6-8051-a9351d14e902. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:00:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] Acquiring lock "cinder-a4eedd30-9fbf-42a0-904a-08795d7397b3-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:00:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] Lock "cinder-a4eedd30-9fbf-42a0-904a-08795d7397b3-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:00:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] Acquiring lock "cinder-quobyte-a4eedd30-9fbf-42a0-904a-08795d7397b3" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:00:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] Lock "cinder-quobyte-a4eedd30-9fbf-42a0-904a-08795d7397b3" acquired by "delete_volume" :: waited 0.044s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:00:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2e399312-42f2-4471-a738-73d2b2fa019b tempest-GroupsTest-1491513031 None] Update group completed successfully. Sep 17 15:00:28 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d61a2d-ab1a-4086-8870-8af0fd460a9d]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:28 devstack sudo[92166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3 Sep 17 15:00:28 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:29 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3" returned: 0 in 0.616s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:29 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3 Sep 17 15:00:29 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] Acquiring lock "cinder-9d44f1fc-260a-4c69-93a3-8c3dc885f04d-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:00:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] Lock "cinder-9d44f1fc-260a-4c69-93a3-8c3dc885f04d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:00:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] Acquiring lock "cinder-quobyte-9d44f1fc-260a-4c69-93a3-8c3dc885f04d" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:00:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] Lock "cinder-quobyte-9d44f1fc-260a-4c69-93a3-8c3dc885f04d" acquired by "delete_volume" :: waited 0.045s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:00:29 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc04943-9c78-48dc-b176-65657bf73ba5]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9d44f1fc-260a-4c69-93a3-8c3dc885f04d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:29 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4eedd30-9fbf-42a0-904a-08795d7397b3" returned: 0 in 0.498s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] Lock "cinder-quobyte-a4eedd30-9fbf-42a0-904a-08795d7397b3" released by "delete_volume" :: held 1.246s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:00:29 devstack cinder-volume[86082]: DEBUG cinder.quota [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] Created reservations ['c431e708-0951-4e9e-95e1-d98e5b691d62', 'ae11ff72-6302-4616-bccc-cb49338ae9c5', '27d21f37-b3f0-4b01-aca9-b25df17e988d', 'ee240206-0ff7-4706-a179-aee2a5f726d7'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:00:29 devstack sudo[92175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9d44f1fc-260a-4c69-93a3-8c3dc885f04d Sep 17 15:00:29 devstack sudo[92175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:30 devstack sudo[92177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:00:30 devstack sudo[92177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:30 devstack sudo[92175]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9d44f1fc-260a-4c69-93a3-8c3dc885f04d" returned: 0 in 0.780s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9d44f1fc-260a-4c69-93a3-8c3dc885f04d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:30 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9d44f1fc-260a-4c69-93a3-8c3dc885f04d Sep 17 15:00:30 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:30 devstack sudo[92177]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.645s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:30 devstack cinder-volume[86082]: DEBUG cinder.manager [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:00:30 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] Deleted volume successfully. Sep 17 15:00:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-7bad24b4-65f3-4a6e-b009-2202abf9334c req-b7c52f86-fcb2-4e5c-80e1-b49e51f09673 tempest-ServerActionsTestOtherA-1114292147 None] Lock "cinder-a4eedd30-9fbf-42a0-904a-08795d7397b3-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:00:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Acquiring lock "cinder-quobyte-25f26f46-eeed-4b98-96a3-091b85f02d8e" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:00:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Lock "cinder-quobyte-25f26f46-eeed-4b98-96a3-091b85f02d8e" acquired by "delete_volume" :: waited 0.036s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:00:30 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9d44f1fc-260a-4c69-93a3-8c3dc885f04d" returned: 0 in 0.554s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:30 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3425fb09-7bef-4387-ae2d-e64f39895420]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-25f26f46-eeed-4b98-96a3-091b85f02d8e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] Lock "cinder-quobyte-9d44f1fc-260a-4c69-93a3-8c3dc885f04d" released by "delete_volume" :: held 1.417s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:00:31 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] Created reservations ['6f10c809-48d4-4776-b5ef-846701df1739', 'aa050b19-f153-4ed1-aa9a-2b1f3e3c21ac', 'b102b689-048a-49d2-aff7-14d60da96ffd', '45c21bdc-c973-4ce7-a030-e5a0e313d954'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:00:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:31 devstack sudo[92189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-25f26f46-eeed-4b98-96a3-091b85f02d8e Sep 17 15:00:31 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:31 devstack sudo[92190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:00:31 devstack sudo[92190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:31 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-25f26f46-eeed-4b98-96a3-091b85f02d8e" returned: 0 in 0.548s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-25f26f46-eeed-4b98-96a3-091b85f02d8e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:31 devstack sudo[92190]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:31 devstack sudo[92197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-25f26f46-eeed-4b98-96a3-091b85f02d8e Sep 17 15:00:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.404s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:31 devstack sudo[92197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:31 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:00:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] Deleted volume successfully. Sep 17 15:00:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4b5a177a-5d40-4631-b794-9accbc25a6bd tempest-ServerActionsTestOtherA-1114292147 None] Lock "cinder-9d44f1fc-260a-4c69-93a3-8c3dc885f04d-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:00:31 devstack sudo[92197]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-25f26f46-eeed-4b98-96a3-091b85f02d8e" returned: 0 in 0.445s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Lock "cinder-quobyte-25f26f46-eeed-4b98-96a3-091b85f02d8e" released by "delete_volume" :: held 1.098s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:00:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Acquiring lock "cinder-quobyte-6ccf6177-4411-4ecf-80f7-8861a451d4ef" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:00:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Lock "cinder-quobyte-6ccf6177-4411-4ecf-80f7-8861a451d4ef" acquired by "delete_volume" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:00:32 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecba6f75-c3fd-4fda-938b-a0993b4ee642]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6ccf6177-4411-4ecf-80f7-8861a451d4ef {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:32 devstack sudo[92202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6ccf6177-4411-4ecf-80f7-8861a451d4ef Sep 17 15:00:32 devstack sudo[92202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:32 devstack sudo[92202]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6ccf6177-4411-4ecf-80f7-8861a451d4ef" returned: 0 in 0.874s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6ccf6177-4411-4ecf-80f7-8861a451d4ef {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:33 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6ccf6177-4411-4ecf-80f7-8861a451d4ef Sep 17 15:00:33 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:33 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6ccf6177-4411-4ecf-80f7-8861a451d4ef" returned: 0 in 0.456s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Lock "cinder-quobyte-6ccf6177-4411-4ecf-80f7-8861a451d4ef" released by "delete_volume" :: held 1.428s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:00:33 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Created reservations ['29f38b03-81d5-44ac-a127-4c890eadeed4'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:00:33 devstack cinder-volume[86082]: WARNING cinder.quota [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-888137586 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-888137586, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:00:33 devstack cinder-volume[86082]: WARNING cinder.quota [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-888137586 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-888137586, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:00:33 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Created reservations ['33245e5b-8556-44ec-991e-e0441d4c75cc', 'dcaa860b-9611-4bad-bb52-cfbf9e39641d', '34c5b678-2d06-48cd-a28a-d1d4de0fdc5d', 'c5f15097-cb68-4fb8-aa77-3e49fe04fc7c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:00:34 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Created reservations ['fbce1baf-4539-4869-bdf5-189a7ff1e4a2', '8e476b16-36bf-4ec6-90e7-c8a382af6437', '52c7d3d9-a999-4f6f-8350-01088bcca001', 'f8e47d28-2f76-4a52-83db-461c60935da0'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:00:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:34 devstack sudo[92235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:00:34 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:34 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.325s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:34 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:00:34 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e4823638-a377-4490-b0b4-4b0dfea37450 tempest-GroupsTest-1491513031 None] Delete group completed successfully. Sep 17 15:00:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:00:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.088s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:40 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:00:40 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:41 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.580s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:41 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:00:41 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:00:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:00:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:00:42 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:00:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Flow 'volume_create_manager' (3ebd0cda-1330-4140-82a4-af3284e5f83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d672db80-92be-43b4-917d-f1effd7efa03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d672db80-92be-43b4-917d-f1effd7efa03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1333542117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=436cab53-a70e-4bc5-bab3-33c6af695378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee5d86e4fbc4b668893271deb513c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:42Z,use_quota=True,user_id='fb7595cd1f8a4c36abdc358f8d373762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c183f84-6251-4843-82a6-2381a0edba00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c183f84-6251-4843-82a6-2381a0edba00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd573ad3-3ba3-4297-96d4-eb59820b032e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:42 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:00:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd573ad3-3ba3-4297-96d4-eb59820b032e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '436cab53-a70e-4bc5-bab3-33c6af695378', 'volume_name': 'volume-436cab53-a70e-4bc5-bab3-33c6af695378', 'volume_size': 1, 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a89aff0fcdbc4ac4a1aadbcc303a1058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd928b357-d516-479a-9030-78a0e857cb53', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d928b357-d516-479a-9030-78a0e857cb53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054391f1-8713-485a-8be0-828a677860b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054391f1-8713-485a-8be0-828a677860b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9da532-9616-4bc8-b113-44e9b8b9ac92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:42 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Volume 436cab53-a70e-4bc5-bab3-33c6af695378: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-436cab53-a70e-4bc5-bab3-33c6af695378', 'volume_size': 1, 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a89aff0fcdbc4ac4a1aadbcc303a1058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd928b357-d516-479a-9030-78a0e857cb53', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d928b357-d516-479a-9030-78a0e857cb53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 15:00:42 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Trying to clone 436cab53-a70e-4bc5-bab3-33c6af695378 from image d928b357-d516-479a-9030-78a0e857cb53 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:00:43 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_9wwwqy00devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 15:00:43 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Image download 20.69 MB at 20.69 MB/s Sep 17 15:00:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a4bed3-7885-4d3f-9efb-9ce26d2ac0d7]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_9wwwqy00devstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:43 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_9wwwqy00devstack@QuobyteHD Sep 17 15:00:43 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:44 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_9wwwqy00devstack@QuobyteHD" returned: 0 in 0.549s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:44 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Temporary image d928b357-d516-479a-9030-78a0e857cb53 is fetched for user fb7595cd1f8a4c36abdc358f8d373762. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 15:00:44 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcf34d5-1281-4540-935f-6385e6845487]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_9wwwqy00devstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:44 devstack sudo[92343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_9wwwqy00devstack@QuobyteHD Sep 17 15:00:44 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:44 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_9wwwqy00devstack@QuobyteHD" returned: 0 in 0.569s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1333542117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=436cab53-a70e-4bc5-bab3-33c6af695378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee5d86e4fbc4b668893271deb513c2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:42Z,use_quota=True,user_id='fb7595cd1f8a4c36abdc358f8d373762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:00:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Creating volume 436cab53-a70e-4bc5-bab3-33c6af695378 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:00:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:00:44 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:00:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:44 devstack sudo[92354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378 1073741824 Sep 17 15:00:44 devstack sudo[92354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:45 devstack sudo[92354]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378 1073741824" returned: 0 in 0.772s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:45 devstack sudo[92395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378 Sep 17 15:00:45 devstack sudo[92395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:46 devstack sudo[92395]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378" returned: 0 in 0.504s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:00:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:46 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Attempting download of d928b357-d516-479a-9030-78a0e857cb53 ((None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}])) to volume 436cab53-a70e-4bc5-bab3-33c6af695378. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:00:46 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f283d2-3903-4638-8aa2-85c24c5a0991]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_fvjndupo {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:46 devstack sudo[92398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_fvjndupo Sep 17 15:00:46 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:46 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_fvjndupo" returned: 0 in 0.573s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_fvjndupo {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:47 devstack sudo[92404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_fvjndupo Sep 17 15:00:47 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:47 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_fvjndupo" returned: 1 in 0.465s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_fvjndupo' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:00:47 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6af48b-745d-43ca-8572-73e201b302ef]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_9wwwqy00devstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:47 devstack sudo[92409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_9wwwqy00devstack@QuobyteHD Sep 17 15:00:47 devstack sudo[92409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:47 devstack sudo[92409]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_9wwwqy00devstack@QuobyteHD" returned: 0 in 0.519s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:47 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] d928b357-d516-479a-9030-78a0e857cb53 was qcow2, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 15:00:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_9wwwqy00devstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:47 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-18235fb8-6ae1-4821-8df0-01a03dd395ee tempest-GroupsV314Test-2088977521 None] Group tempest-GroupsV314Test-Group-936256941: creating Sep 17 15:00:48 devstack sudo[92414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_9wwwqy00devstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378 Sep 17 15:00:48 devstack sudo[92414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:48 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-18235fb8-6ae1-4821-8df0-01a03dd395ee tempest-GroupsV314Test-2088977521 None] Group tempest-GroupsV314Test-Group-936256941: created successfully Sep 17 15:00:48 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-18235fb8-6ae1-4821-8df0-01a03dd395ee tempest-GroupsV314Test-2088977521 None] Create group completed successfully. Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Flow 'volume_create_manager' (2fa4f835-69dc-4c1b-ae94-dd400f4d033c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cc50de-075c-4524-a6d8-dfe9dca16202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39cc50de-075c-4524-a6d8-dfe9dca16202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1974852100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f22d6171-eafe-45ad-b668-59db512e83ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d44ea7a1d14e4168958111ba8c81b8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:49Z,use_quota=True,user_id='648e4f26201e4fe186326781f6b53ef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0128c647-6fbe-434d-b83e-c9c78093179c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0128c647-6fbe-434d-b83e-c9c78093179c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f787520-3937-457d-8f74-6825c2cfe990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f787520-3937-457d-8f74-6825c2cfe990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f22d6171-eafe-45ad-b668-59db512e83ee', 'volume_name': 'volume-f22d6171-eafe-45ad-b668-59db512e83ee', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca1f31f-fd1f-44fd-b57f-d5f4db3534aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca1f31f-fd1f-44fd-b57f-d5f4db3534aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bef72da-2f78-4e65-aa2e-4ad3bea64dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:49 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Volume f22d6171-eafe-45ad-b668-59db512e83ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f22d6171-eafe-45ad-b668-59db512e83ee', 'volume_size': 1} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1974852100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f22d6171-eafe-45ad-b668-59db512e83ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d44ea7a1d14e4168958111ba8c81b8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:49Z,use_quota=True,user_id='648e4f26201e4fe186326781f6b53ef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Creating volume f22d6171-eafe-45ad-b668-59db512e83ee {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:00:49 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f22d6171-eafe-45ad-b668-59db512e83ee 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:49 devstack sudo[92422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f22d6171-eafe-45ad-b668-59db512e83ee 1073741824 Sep 17 15:00:49 devstack sudo[92422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Flow 'volume_create_manager' (ae7671fd-2900-4640-aa1b-0718e432f3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74c498b-efa5-476b-bad9-8839091687d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74c498b-efa5-476b-bad9-8839091687d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-907036288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f001b15-b5e9-41fe-b769-c00bf1c460f3,host='devstack@QuobyteHD#QuobyteHD',id=a08d6f7f-8a47-4a79-b273-65d1bac34314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccef0efbe5854274a3214c0e50ded6b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:50Z,use_quota=True,user_id='b0de10094d87419a9a416ea319c91035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b0ff640-f59e-43ca-95ee-f94bbac38c47),volume_type_id=5b0ff640-f59e-43ca-95ee-f94bbac38c47)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (600807fa-8795-4021-adf5-64a87150ddae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (600807fa-8795-4021-adf5-64a87150ddae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d7e114-e6b1-4b23-878c-74f5bf3c0036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d7e114-e6b1-4b23-878c-74f5bf3c0036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a08d6f7f-8a47-4a79-b273-65d1bac34314', 'volume_name': 'volume-a08d6f7f-8a47-4a79-b273-65d1bac34314', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4591d3a9-9fa2-4138-a5aa-6b0a0ffceada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4591d3a9-9fa2-4138-a5aa-6b0a0ffceada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135465b5-9cbc-4602-96e4-f0d3a82b37d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:50 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Volume a08d6f7f-8a47-4a79-b273-65d1bac34314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a08d6f7f-8a47-4a79-b273-65d1bac34314', 'volume_size': 1} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:50 devstack sudo[92422]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f22d6171-eafe-45ad-b668-59db512e83ee 1073741824" returned: 0 in 0.658s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f22d6171-eafe-45ad-b668-59db512e83ee {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:50 devstack sudo[92428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f22d6171-eafe-45ad-b668-59db512e83ee Sep 17 15:00:50 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:50 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f22d6171-eafe-45ad-b668-59db512e83ee" returned: 0 in 0.274s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.379s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9f001b15-b5e9-41fe-b769-c00bf1c460f3,created_at=2026-09-17T13:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-907036288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f001b15-b5e9-41fe-b769-c00bf1c460f3,host='devstack@QuobyteHD#QuobyteHD',id=a08d6f7f-8a47-4a79-b273-65d1bac34314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccef0efbe5854274a3214c0e50ded6b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:50Z,use_quota=True,user_id='b0de10094d87419a9a416ea319c91035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b0ff640-f59e-43ca-95ee-f94bbac38c47),volume_type_id=5b0ff640-f59e-43ca-95ee-f94bbac38c47)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Creating volume a08d6f7f-8a47-4a79-b273-65d1bac34314 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:00:50 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:50 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 1073741824 Sep 17 15:00:50 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bef72da-2f78-4e65-aa2e-4ad3bea64dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f22d6171-eafe-45ad-b668-59db512e83ee', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c631d2bf-e5f9-4082-a8e5-1648e9c6f768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:50 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Volume volume-f22d6171-eafe-45ad-b668-59db512e83ee (f22d6171-eafe-45ad-b668-59db512e83ee): created successfully Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c631d2bf-e5f9-4082-a8e5-1648e9c6f768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Flow 'volume_create_manager' (2fa4f835-69dc-4c1b-ae94-dd400f4d033c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-58ede723-63a7-4280-9d11-65edee49e6d6 tempest-ServersNegativeTestJSON-1810539018 None] Created volume successfully. Sep 17 15:00:50 devstack sudo[92414]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_9wwwqy00devstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378" returned: 0 in 2.662s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_9wwwqy00devstack@QuobyteHD, size 112.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:00:50 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Converted 112.00 MB image at 42.06 MB/s Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:50 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378 1G Sep 17 15:00:50 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:50 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 1073741824" returned: 0 in 0.508s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:51 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:51 devstack sudo[92444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 Sep 17 15:00:51 devstack sudo[92444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378 1G" returned: 0 in 0.393s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:51 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Downloaded image d928b357-d516-479a-9030-78a0e857cb53 ((None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}])) to volume 436cab53-a70e-4bc5-bab3-33c6af695378 successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:00:51 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Temporary image d928b357-d516-479a-9030-78a0e857cb53 for user fb7595cd1f8a4c36abdc358f8d373762 is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 15:00:51 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Marking volume 436cab53-a70e-4bc5-bab3-33c6af695378 as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:00:51 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Copying metadata from image d928b357-d516-479a-9030-78a0e857cb53 to 436cab53-a70e-4bc5-bab3-33c6af695378. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:00:51 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Creating volume glance metadata for volume 436cab53-a70e-4bc5-bab3-33c6af695378 backed by image d928b357-d516-479a-9030-78a0e857cb53 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:00:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9da532-9616-4bc8-b113-44e9b8b9ac92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-436cab53-a70e-4bc5-bab3-33c6af695378', 'volume_size': 1, 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a89aff0fcdbc4ac4a1aadbcc303a1058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd928b357-d516-479a-9030-78a0e857cb53', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d928b357-d516-479a-9030-78a0e857cb53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7db893-d265-4609-a8a2-cee11d23c6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Volume volume-436cab53-a70e-4bc5-bab3-33c6af695378 (436cab53-a70e-4bc5-bab3-33c6af695378): created successfully Sep 17 15:00:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7db893-d265-4609-a8a2-cee11d23c6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Flow 'volume_create_manager' (3ebd0cda-1330-4140-82a4-af3284e5f83f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a0f9b1cd-3e2b-43bd-85f8-b40f8f99fd03 tempest-VolumesImageMetadata-882830536 None] Created volume successfully. Sep 17 15:00:51 devstack sudo[92444]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314" returned: 0 in 0.382s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:00:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (135465b5-9cbc-4602-96e4-f0d3a82b37d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a08d6f7f-8a47-4a79-b273-65d1bac34314', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250178b8-61be-4cc5-a80b-02755aad74a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Volume volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 (a08d6f7f-8a47-4a79-b273-65d1bac34314): created successfully Sep 17 15:00:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (250178b8-61be-4cc5-a80b-02755aad74a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Flow 'volume_create_manager' (ae7671fd-2900-4640-aa1b-0718e432f3b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a0cded34-e082-47e0-b52a-7e4eb0d5dce2 tempest-GroupsV314Test-2088977521 None] Created volume successfully. Sep 17 15:00:52 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Flow 'volume_create_manager' (fc2e0a26-1eb9-4489-bbb5-07deceed7a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb765e9-0bb8-4986-8d04-5d923b318125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] Acquiring lock "cinder-436cab53-a70e-4bc5-bab3-33c6af695378-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb765e9-0bb8-4986-8d04-5d923b318125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-371784881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0021b096-58d4-4c64-973c-be40a0b195d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d44ea7a1d14e4168958111ba8c81b8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:53Z,use_quota=True,user_id='648e4f26201e4fe186326781f6b53ef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64d918af-7094-480f-ab7c-531096157cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64d918af-7094-480f-ab7c-531096157cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47099a0f-6dc4-4fb8-8097-64802f10285b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47099a0f-6dc4-4fb8-8097-64802f10285b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0021b096-58d4-4c64-973c-be40a0b195d3', 'volume_name': 'volume-0021b096-58d4-4c64-973c-be40a0b195d3', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbdd4883-4811-4725-bafa-d59ceae3fb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbdd4883-4811-4725-bafa-d59ceae3fb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2958f48-1c36-4b3a-8d8d-914939267831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:53 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Volume 0021b096-58d4-4c64-973c-be40a0b195d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0021b096-58d4-4c64-973c-be40a0b195d3', 'volume_size': 1} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-371784881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0021b096-58d4-4c64-973c-be40a0b195d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d44ea7a1d14e4168958111ba8c81b8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:53Z,use_quota=True,user_id='648e4f26201e4fe186326781f6b53ef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Creating volume 0021b096-58d4-4c64-973c-be40a0b195d3 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:00:53 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0021b096-58d4-4c64-973c-be40a0b195d3 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] Lock "cinder-436cab53-a70e-4bc5-bab3-33c6af695378-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:00:53 devstack sudo[92448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0021b096-58d4-4c64-973c-be40a0b195d3 1073741824 Sep 17 15:00:53 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] Acquiring lock "cinder-quobyte-436cab53-a70e-4bc5-bab3-33c6af695378" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] Lock "cinder-quobyte-436cab53-a70e-4bc5-bab3-33c6af695378" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4910ad3e-5ae7-4606-80d1-624718637827]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:53 devstack sudo[92450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378 Sep 17 15:00:53 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:53 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0021b096-58d4-4c64-973c-be40a0b195d3 1073741824" returned: 0 in 0.585s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0021b096-58d4-4c64-973c-be40a0b195d3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:53 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0021b096-58d4-4c64-973c-be40a0b195d3 Sep 17 15:00:53 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:53 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378" returned: 0 in 0.591s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:53 devstack sudo[92461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378 Sep 17 15:00:53 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:54 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0021b096-58d4-4c64-973c-be40a0b195d3" returned: 0 in 0.278s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.596s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:54 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Cloning volume a08d6f7f-8a47-4a79-b273-65d1bac34314 to volume b841e24f-e26d-4c10-8e5e-23f260e53873 Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2958f48-1c36-4b3a-8d8d-914939267831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0021b096-58d4-4c64-973c-be40a0b195d3', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c3beed-6dd9-4a0e-bdf0-a71b7d8946d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Creating offline snapshot 80e9eaff-f60e-42bf-821a-340660c98a40 of volume a08d6f7f-8a47-4a79-b273-65d1bac34314 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:00:54 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Volume volume-0021b096-58d4-4c64-973c-be40a0b195d3 (0021b096-58d4-4c64-973c-be40a0b195d3): created successfully Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c3beed-6dd9-4a0e-bdf0-a71b7d8946d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Flow 'volume_create_manager' (fc2e0a26-1eb9-4489-bbb5-07deceed7a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4fcb20-2885-42d9-9415-a6814e63164c]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:54 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:54 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3ca55144-6e2c-43ea-a4d9-0950fddb4069 tempest-ServersNegativeTestJSON-1810539018 None] Created volume successfully. Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-436cab53-a70e-4bc5-bab3-33c6af695378" returned: 0 in 0.314s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] Lock "cinder-quobyte-436cab53-a70e-4bc5-bab3-33c6af695378" released by "delete_volume" :: held 0.976s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] Created reservations ['37556cf1-8058-4e44-8519-9c1665c0ccbc', '61fe5195-9629-44c9-a3ac-cf23709da15d', 'fd9e5865-0511-4729-b5c3-7eb231bff0ae', '57acf8e8-f8df-441e-bfb9-a5a9615c8943'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:00:54 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 Sep 17 15:00:54 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:54 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:00:54 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:54 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.273s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:00:54 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] Deleted volume successfully. Sep 17 15:00:54 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314" returned: 0 in 0.466s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c479d57a-7ea5-442c-b8b9-063bf294ddc3 tempest-VolumesImageMetadata-882830536 None] Lock "cinder-436cab53-a70e-4bc5-bab3-33c6af695378-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:00:54 devstack sudo[92474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40 1G Sep 17 15:00:54 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:55 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40 1G" returned: 0 in 0.579s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:55 devstack sudo[92480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40 Sep 17 15:00:55 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] Acquiring lock "cinder-0021b096-58d4-4c64-973c-be40a0b195d3-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:00:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] Lock "cinder-0021b096-58d4-4c64-973c-be40a0b195d3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:00:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] Acquiring lock "cinder-quobyte-0021b096-58d4-4c64-973c-be40a0b195d3" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:00:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] Lock "cinder-quobyte-0021b096-58d4-4c64-973c-be40a0b195d3" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:00:55 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a75184-5ea8-4a0c-bbbf-69b3779eb5d5]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0021b096-58d4-4c64-973c-be40a0b195d3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:55 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40" returned: 0 in 0.394s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:55 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 15:00:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:55 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40 Sep 17 15:00:55 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:55 devstack sudo[92486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0021b096-58d4-4c64-973c-be40a0b195d3 Sep 17 15:00:55 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:55 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40" returned: 0 in 0.299s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:55 devstack sudo[92492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.info Sep 17 15:00:55 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:56 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0021b096-58d4-4c64-973c-be40a0b195d3" returned: 0 in 0.477s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0021b096-58d4-4c64-973c-be40a0b195d3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:56 devstack sudo[92496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0021b096-58d4-4c64-973c-be40a0b195d3 Sep 17 15:00:56 devstack sudo[92496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:56 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.info" returned: 0 in 0.336s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:56 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:56 devstack sudo[92499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.info Sep 17 15:00:56 devstack sudo[92499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:56 devstack sudo[92496]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0021b096-58d4-4c64-973c-be40a0b195d3" returned: 0 in 0.402s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] Lock "cinder-quobyte-0021b096-58d4-4c64-973c-be40a0b195d3" released by "delete_volume" :: held 1.015s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] Created reservations ['a1b695f9-d1a8-4612-b358-1ca1f0791d72', '5ac7d938-107f-44fd-b094-fcfb6ed72357', '50aa2bca-d92e-44f7-b1d6-4ea3ce3265d4', 'af143904-a8d8-4ac6-86f9-5d63b7e6e076'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:56 devstack sudo[92503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:00:56 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:56 devstack sudo[92499]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.info" returned: 0 in 0.490s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Acquiring lock "cinder-quobyte-b841e24f-e26d-4c10-8e5e-23f260e53873" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Lock "cinder-quobyte-b841e24f-e26d-4c10-8e5e-23f260e53873" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] snapshot: 80e9eaff-f60e-42bf-821a-340660c98a40, volume: b841e24f-e26d-4c10-8e5e-23f260e53873, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce05b915-f685-4cc5-9766-3a6732723fe4]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:56 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.309s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:56 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:00:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] Deleted volume successfully. Sep 17 15:00:57 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40 Sep 17 15:00:57 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-df7be84d-2de5-40c6-876e-abdf873518d4 tempest-ServersNegativeTestJSON-1810539018 None] Lock "cinder-0021b096-58d4-4c64-973c-be40a0b195d3-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:00:57 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40" returned: 0 in 0.501s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a08d6f7f-8a47-4a79-b273-65d1bac34314(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:00:57 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18ede6d-6fb1-4589-9244-e0788eb17d14]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:57 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 Sep 17 15:00:57 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] Acquiring lock "cinder-f22d6171-eafe-45ad-b668-59db512e83ee-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:00:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] Lock "cinder-f22d6171-eafe-45ad-b668-59db512e83ee-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:00:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] Acquiring lock "cinder-quobyte-f22d6171-eafe-45ad-b668-59db512e83ee" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:00:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] Lock "cinder-quobyte-f22d6171-eafe-45ad-b668-59db512e83ee" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:00:57 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae80d19-862a-4418-ad87-41bbd2a4ec87]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f22d6171-eafe-45ad-b668-59db512e83ee {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:57 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314" returned: 0 in 0.613s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:00:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:00:58 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Path /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b841e24f-e26d-4c10-8e5e-23f260e53873 not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:00:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b841e24f-e26d-4c10-8e5e-23f260e53873 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:58 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b841e24f-e26d-4c10-8e5e-23f260e53873 Sep 17 15:00:58 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:58 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f22d6171-eafe-45ad-b668-59db512e83ee Sep 17 15:00:58 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:58 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f22d6171-eafe-45ad-b668-59db512e83ee" returned: 0 in 0.544s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f22d6171-eafe-45ad-b668-59db512e83ee {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:58 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f22d6171-eafe-45ad-b668-59db512e83ee Sep 17 15:00:58 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:59 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f22d6171-eafe-45ad-b668-59db512e83ee" returned: 0 in 0.630s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] Lock "cinder-quobyte-f22d6171-eafe-45ad-b668-59db512e83ee" released by "delete_volume" :: held 1.276s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:00:59 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] Created reservations ['df0de825-bb1f-4ab5-86e3-d1471e5b2249', '93f6b3da-1403-4a42-ad1b-9d91b5d81e4a', '3fea1d03-210e-4aaa-8a3e-cdd2cb14a6b2', '19c9d7b6-5b93-4b03-b8ee-61378b68dfeb'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:00:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:59 devstack sudo[92539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:00:59 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:00 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.482s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:01:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] Deleted volume successfully. Sep 17 15:01:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e6e4fb65-a272-4964-815b-022292cd2073 tempest-ServersNegativeTestJSON-1810539018 None] Lock "cinder-f22d6171-eafe-45ad-b668-59db512e83ee-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b841e24f-e26d-4c10-8e5e-23f260e53873" returned: 0 in 10.459s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:08 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Image conversion details: src /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314, size 1024.00 MB, duration 10.46 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b841e24f-e26d-4c10-8e5e-23f260e53873 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:01:08 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Converted 1024.00 MB image at 97.90 MB/s Sep 17 15:01:08 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b841e24f-e26d-4c10-8e5e-23f260e53873 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 15:01:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b841e24f-e26d-4c10-8e5e-23f260e53873 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:08 devstack sudo[92606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b841e24f-e26d-4c10-8e5e-23f260e53873 Sep 17 15:01:08 devstack sudo[92606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:08 devstack sudo[92606]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b841e24f-e26d-4c10-8e5e-23f260e53873" returned: 0 in 0.291s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Lock "cinder-quobyte-b841e24f-e26d-4c10-8e5e-23f260e53873" released by "_copy_volume_from_snapshot" :: held 11.987s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:08 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=116,cinder:SELECT=90,cinder:INSERT=39,cinder:DELETE=5 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:01:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Acquiring lock "cinder-quobyte-80e9eaff-f60e-42bf-821a-340660c98a40" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Lock "cinder-quobyte-80e9eaff-f60e-42bf-821a-340660c98a40" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Deleting offline snapshot 80e9eaff-f60e-42bf-821a-340660c98a40 of volume a08d6f7f-8a47-4a79-b273-65d1bac34314 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:01:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] snapshot_file for this snap is: volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:01:08 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36ae186-67b4-4e8b-8994-909de474f7c5]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:09 devstack sudo[92610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40 Sep 17 15:01:09 devstack sudo[92610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:09 devstack sudo[92610]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40" returned: 0 in 0.457s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a08d6f7f-8a47-4a79-b273-65d1bac34314(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:01:09 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3593983c-8b1d-4603-be98-bb427a53dd97]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:09 devstack sudo[92615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 Sep 17 15:01:09 devstack sudo[92615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:10 devstack sudo[92615]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314" returned: 0 in 0.623s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:10 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40 Sep 17 15:01:10 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=103,cinder:UPDATE=108,cinder:INSERT=23,cinder:DELETE=9 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:01:10 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40" returned: 0 in 0.427s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:10 devstack sudo[92627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40 Sep 17 15:01:10 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:10 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314.80e9eaff-f60e-42bf-821a-340660c98a40" returned: 0 in 0.327s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Lock "cinder-quobyte-80e9eaff-f60e-42bf-821a-340660c98a40" released by "_delete_snapshot" :: held 1.978s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Flow 'volume_create_manager' (b7255ba1-2c62-4497-a971-71e97e6add4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a093e51f-820c-4a83-83e6-536ee33d0a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.836s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a093e51f-820c-4a83-83e6-536ee33d0a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-396600876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807a8bf8-eccc-4712-9322-778df4e65d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4428f346e9442bd807348db45f6696e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:11Z,use_quota=True,user_id='50c03e222bbf4910b8299f2f74856f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c518687-7f53-434d-be01-ceab95207dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c518687-7f53-434d-be01-ceab95207dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4414f6d0-f6b7-4ca2-bebc-71cc8bded798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4414f6d0-f6b7-4ca2-bebc-71cc8bded798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '807a8bf8-eccc-4712-9322-778df4e65d57', 'volume_name': 'volume-807a8bf8-eccc-4712-9322-778df4e65d57', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a07c54-9618-465a-8559-e7fc510a93b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a07c54-9618-465a-8559-e7fc510a93b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe2fcfb-6f42-464a-9322-036c9308da4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:10 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Volume 807a8bf8-eccc-4712-9322-778df4e65d57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-807a8bf8-eccc-4712-9322-778df4e65d57', 'volume_size': 1} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-396600876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807a8bf8-eccc-4712-9322-778df4e65d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4428f346e9442bd807348db45f6696e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:11Z,use_quota=True,user_id='50c03e222bbf4910b8299f2f74856f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Creating volume 807a8bf8-eccc-4712-9322-778df4e65d57 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:01:10 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:01:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:10 devstack sudo[92633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57 1073741824 Sep 17 15:01:10 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-38c3be84-3034-4526-8cb5-1363f05e9219 tempest-GroupsV314Test-2088977521 None] Create group from source-group-9f001b15-b5e9-41fe-b769-c00bf1c460f3 completed successfully. Sep 17 15:01:11 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57 1073741824" returned: 0 in 0.629s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:11 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57 Sep 17 15:01:11 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:11 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57" returned: 0 in 0.327s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:01:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe2fcfb-6f42-464a-9322-036c9308da4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-807a8bf8-eccc-4712-9322-778df4e65d57', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd563a0-fcbf-4108-8057-7cf797f95cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] Acquiring lock "cinder-quobyte-b841e24f-e26d-4c10-8e5e-23f260e53873" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:11 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Volume volume-807a8bf8-eccc-4712-9322-778df4e65d57 (807a8bf8-eccc-4712-9322-778df4e65d57): created successfully Sep 17 15:01:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd563a0-fcbf-4108-8057-7cf797f95cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Flow 'volume_create_manager' (b7255ba1-2c62-4497-a971-71e97e6add4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] Lock "cinder-quobyte-b841e24f-e26d-4c10-8e5e-23f260e53873" acquired by "delete_volume" :: waited 0.035s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:12 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0b5a1135-dd95-4341-8b52-15afffa39cf6 tempest-VolumesDeleteCascade-1663895352 None] Created volume successfully. Sep 17 15:01:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc04f31-7a43-4aca-bf87-cd2da36f1683]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b841e24f-e26d-4c10-8e5e-23f260e53873 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:12 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b841e24f-e26d-4c10-8e5e-23f260e53873 Sep 17 15:01:12 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:12 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b841e24f-e26d-4c10-8e5e-23f260e53873" returned: 0 in 0.496s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b841e24f-e26d-4c10-8e5e-23f260e53873 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:12 devstack sudo[92648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b841e24f-e26d-4c10-8e5e-23f260e53873 Sep 17 15:01:12 devstack sudo[92648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:13 devstack sudo[92648]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b841e24f-e26d-4c10-8e5e-23f260e53873" returned: 0 in 0.440s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] Lock "cinder-quobyte-b841e24f-e26d-4c10-8e5e-23f260e53873" released by "delete_volume" :: held 1.023s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] Created reservations ['a73afb76-2f55-4ad0-9a2a-3246467d486f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:13 devstack cinder-volume[86082]: WARNING cinder.quota [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1555474605 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1555474605, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:01:13 devstack cinder-volume[86082]: WARNING cinder.quota [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1555474605 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1555474605, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] Creating offline snapshot ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 of volume 807a8bf8-eccc-4712-9322-778df4e65d57 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bfd6de-b512-489f-b6b9-1a36200a3c39]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] Created reservations ['d2d0974e-3170-4790-9cbf-9c18ba7621a9', '58a414bc-e9a6-4761-a059-8b0669ccce7e', 'd18e10be-9e86-4d6b-be65-69298986c7f2', '9c4ba591-bab9-49c5-bd3e-26178d847b8e'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:13 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57 Sep 17 15:01:13 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:13 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:01:13 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:13 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57" returned: 0 in 0.580s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:13 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.408s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:13 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:01:13 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b944eceb-49d1-4f4f-bc0b-0237ec7c2f98 tempest-GroupsV314Test-2088977521 None] Delete group completed successfully. Sep 17 15:01:13 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 1G Sep 17 15:01:13 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:14 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 1G" returned: 0 in 0.503s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807a8bf8-eccc-4712-9322-778df4e65d57 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:14 devstack sudo[92689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807a8bf8-eccc-4712-9322-778df4e65d57 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 Sep 17 15:01:14 devstack sudo[92689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-68ffa6f3-b612-46cd-bbf4-df88dd86633e tempest-GroupsV314Test-2088977521 None] Acquiring lock "cinder-quobyte-a08d6f7f-8a47-4a79-b273-65d1bac34314" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-68ffa6f3-b612-46cd-bbf4-df88dd86633e tempest-GroupsV314Test-2088977521 None] Lock "cinder-quobyte-a08d6f7f-8a47-4a79-b273-65d1bac34314" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:14 devstack sudo[92689]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807a8bf8-eccc-4712-9322-778df4e65d57 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56" returned: 0 in 0.479s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:14 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 is being set with open permissions: ugo+rw Sep 17 15:01:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:14 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 Sep 17 15:01:14 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:14 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c901e9e-2f1d-425d-9264-511c375b7a21]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-68ffa6f3-b612-46cd-bbf4-df88dd86633e tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:15 devstack sudo[92697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 Sep 17 15:01:15 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:15 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56" returned: 0 in 0.441s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:15 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.info Sep 17 15:01:15 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:15 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-68ffa6f3-b612-46cd-bbf4-df88dd86633e tempest-GroupsV314Test-2088977521 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314" returned: 0 in 0.571s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-68ffa6f3-b612-46cd-bbf4-df88dd86633e tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:15 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314 Sep 17 15:01:15 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:15 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-68ffa6f3-b612-46cd-bbf4-df88dd86633e tempest-GroupsV314Test-2088977521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a08d6f7f-8a47-4a79-b273-65d1bac34314" returned: 0 in 0.350s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:15 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.info" returned: 0 in 0.490s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:15 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.info is being set with open permissions: ugo+rw Sep 17 15:01:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-68ffa6f3-b612-46cd-bbf4-df88dd86633e tempest-GroupsV314Test-2088977521 None] Lock "cinder-quobyte-a08d6f7f-8a47-4a79-b273-65d1bac34314" released by "delete_volume" :: held 1.077s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:15 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.info Sep 17 15:01:15 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:16 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-68ffa6f3-b612-46cd-bbf4-df88dd86633e tempest-GroupsV314Test-2088977521 None] Created reservations ['76ecf2fe-b73f-42cc-8c09-2503510d820a'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:01:16 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-68ffa6f3-b612-46cd-bbf4-df88dd86633e tempest-GroupsV314Test-2088977521 None] Created reservations ['f03669d5-1611-40e7-8be3-0371071b33b9', '2c5d111c-c25b-44d2-8080-21b013db0495', '6972c1d9-a533-4255-91d8-429fdead3a43', '27cf1b7e-16cd-4788-a3a6-5692c5ce583b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:01:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-68ffa6f3-b612-46cd-bbf4-df88dd86633e tempest-GroupsV314Test-2088977521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-68ffa6f3-b612-46cd-bbf4-df88dd86633e tempest-GroupsV314Test-2088977521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-68ffa6f3-b612-46cd-bbf4-df88dd86633e tempest-GroupsV314Test-2088977521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-68ffa6f3-b612-46cd-bbf4-df88dd86633e tempest-GroupsV314Test-2088977521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-68ffa6f3-b612-46cd-bbf4-df88dd86633e tempest-GroupsV314Test-2088977521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-68ffa6f3-b612-46cd-bbf4-df88dd86633e tempest-GroupsV314Test-2088977521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:16 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.info" returned: 0 in 0.514s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:16 devstack sudo[92721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:01:16 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.238s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:16 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-54bcdf85-41b7-468a-8c2d-9e86faf44041 tempest-VolumesDeleteCascade-1663895352 None] Create snapshot completed successfully Sep 17 15:01:16 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-68ffa6f3-b612-46cd-bbf4-df88dd86633e tempest-GroupsV314Test-2088977521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.479s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:16 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-68ffa6f3-b612-46cd-bbf4-df88dd86633e tempest-GroupsV314Test-2088977521 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:01:16 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-68ffa6f3-b612-46cd-bbf4-df88dd86633e tempest-GroupsV314Test-2088977521 None] Delete group completed successfully. Sep 17 15:01:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b02887d9-1e8d-4f41-bff1-2a615c41ea36 tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b02887d9-1e8d-4f41-bff1-2a615c41ea36 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b02887d9-1e8d-4f41-bff1-2a615c41ea36 tempest-VolumesDeleteCascade-1663895352 None] Creating offline snapshot efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 of volume 807a8bf8-eccc-4712-9322-778df4e65d57 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:01:17 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1464c226-1556-425d-aaa0-347587c99d8c]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b02887d9-1e8d-4f41-bff1-2a615c41ea36 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:18 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 Sep 17 15:01:18 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:18 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b02887d9-1e8d-4f41-bff1-2a615c41ea36 tempest-VolumesDeleteCascade-1663895352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56" returned: 0 in 0.747s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b02887d9-1e8d-4f41-bff1-2a615c41ea36 tempest-VolumesDeleteCascade-1663895352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-807a8bf8-eccc-4712-9322-778df4e65d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:01:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b02887d9-1e8d-4f41-bff1-2a615c41ea36 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:18 devstack sudo[92790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 1G Sep 17 15:01:18 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:19 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b02887d9-1e8d-4f41-bff1-2a615c41ea36 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 1G" returned: 0 in 0.885s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b02887d9-1e8d-4f41-bff1-2a615c41ea36 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:19 devstack sudo[92795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 Sep 17 15:01:19 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:19 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b02887d9-1e8d-4f41-bff1-2a615c41ea36 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3" returned: 0 in 0.426s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:20 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-b02887d9-1e8d-4f41-bff1-2a615c41ea36 tempest-VolumesDeleteCascade-1663895352 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 is being set with open permissions: ugo+rw Sep 17 15:01:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b02887d9-1e8d-4f41-bff1-2a615c41ea36 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:20 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 Sep 17 15:01:20 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:20 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b02887d9-1e8d-4f41-bff1-2a615c41ea36 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3" returned: 0 in 0.285s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b02887d9-1e8d-4f41-bff1-2a615c41ea36 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:20 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b02887d9-1e8d-4f41-bff1-2a615c41ea36 tempest-VolumesDeleteCascade-1663895352 None] Create snapshot completed successfully Sep 17 15:01:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "cinder-807a8bf8-eccc-4712-9322-778df4e65d57-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-807a8bf8-eccc-4712-9322-778df4e65d57-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Performing cascade delete. {{(pid=86082) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 17 15:01:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "cinder-ecc140e2-1f89-423f-9eca-dc9ea7c3bc56-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-ecc140e2-1f89-423f-9eca-dc9ea7c3bc56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "cinder-quobyte-807a8bf8-eccc-4712-9322-778df4e65d57" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-807a8bf8-eccc-4712-9322-778df4e65d57" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "cinder-quobyte-ecc140e2-1f89-423f-9eca-dc9ea7c3bc56" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-ecc140e2-1f89-423f-9eca-dc9ea7c3bc56" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Deleting offline snapshot ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 of volume 807a8bf8-eccc-4712-9322-778df4e65d57 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:01:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] snapshot_file for this snap is: volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:01:21 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef94a784-9c01-41c0-ad0d-69519aebb618]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:21 devstack sudo[92804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 Sep 17 15:01:21 devstack sudo[92804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:22 devstack sudo[92804]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56" returned: 0 in 0.529s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-807a8bf8-eccc-4712-9322-778df4e65d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:01:22 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6c3aff-7827-4dd7-bb80-863d369c6040]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:22 devstack sudo[92809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57 Sep 17 15:01:22 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:22 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57" returned: 0 in 0.618s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:22 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2316fbba-445c-4f9e-9bf8-49feba2c87ac]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:22 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 Sep 17 15:01:22 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:23 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3" returned: 0 in 0.558s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-807a8bf8-eccc-4712-9322-778df4e65d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:01:23 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbe87d7-53d4-494c-8bcc-8299fa0beaeb]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:23 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 Sep 17 15:01:23 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:24 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56" returned: 0 in 0.649s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-807a8bf8-eccc-4712-9322-778df4e65d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:01:24 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bf6d2d-1deb-44bd-be35-b86096963a49]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:24 devstack sudo[92827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57 Sep 17 15:01:24 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:24 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57" returned: 0 in 0.926s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:25 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 Sep 17 15:01:25 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:25 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56" returned: 0 in 0.569s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:25 devstack sudo[92838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56 Sep 17 15:01:25 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:26 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.ecc140e2-1f89-423f-9eca-dc9ea7c3bc56" returned: 0 in 0.503s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807a8bf8-eccc-4712-9322-778df4e65d57 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 -F qcow2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:26 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807a8bf8-eccc-4712-9322-778df4e65d57 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 -F qcow2 Sep 17 15:01:26 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:26 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807a8bf8-eccc-4712-9322-778df4e65d57 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 -F qcow2" returned: 0 in 0.481s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-ecc140e2-1f89-423f-9eca-dc9ea7c3bc56" released by "_delete_snapshot" :: held 5.163s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-807a8bf8-eccc-4712-9322-778df4e65d57" released by "delete_snapshot" :: held 5.195s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:26 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Created reservations ['8bbc04ed-6d34-4131-85b3-60d91e0f0fbd', '60d3ef2a-3467-4333-907f-b5a9067dd057', '53d9831a-5309-4b6b-9ff2-d3cb123f3238', '9f6a909d-3e13-460c-803a-0b6cbefed562'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:01:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Delete snapshot completed successfully. Sep 17 15:01:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-ecc140e2-1f89-423f-9eca-dc9ea7c3bc56-delete_snapshot" released by "delete_snapshot" :: held 5.460s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "cinder-efff4ad9-1438-4e92-ab02-9cbc4ff46bc3-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-efff4ad9-1438-4e92-ab02-9cbc4ff46bc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "cinder-quobyte-807a8bf8-eccc-4712-9322-778df4e65d57" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-807a8bf8-eccc-4712-9322-778df4e65d57" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "cinder-quobyte-efff4ad9-1438-4e92-ab02-9cbc4ff46bc3" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-efff4ad9-1438-4e92-ab02-9cbc4ff46bc3" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Deleting offline snapshot efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 of volume 807a8bf8-eccc-4712-9322-778df4e65d57 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:01:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] snapshot_file for this snap is: volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:01:27 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43c0464-51fe-4a7b-a584-baa064058efb]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:27 devstack sudo[92846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 Sep 17 15:01:27 devstack sudo[92846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:27 devstack sudo[92846]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3" returned: 0 in 0.661s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-807a8bf8-eccc-4712-9322-778df4e65d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:01:27 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a2cb86-cf99-4efb-91a2-2d5b77fd1a2a]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:28 devstack sudo[92851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57 Sep 17 15:01:28 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:28 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57" returned: 0 in 0.758s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:28 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 Sep 17 15:01:28 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:29 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3" returned: 0 in 0.609s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:29 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3 Sep 17 15:01:29 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:29 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57.efff4ad9-1438-4e92-ab02-9cbc4ff46bc3" returned: 0 in 0.384s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-efff4ad9-1438-4e92-ab02-9cbc4ff46bc3" released by "_delete_snapshot" :: held 2.630s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-807a8bf8-eccc-4712-9322-778df4e65d57" released by "delete_snapshot" :: held 2.679s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:29 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Created reservations ['7cd9a0c2-ea72-486a-bec2-cba159402a68', 'eba510d1-160f-48ae-b9cf-76b412b65b50', '9e85a2b5-69a4-48b7-9608-b9e7b64a029a', '9c7a924e-2542-4d47-9bde-ae118004be95'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:01:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Delete snapshot completed successfully. Sep 17 15:01:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-efff4ad9-1438-4e92-ab02-9cbc4ff46bc3-delete_snapshot" released by "delete_snapshot" :: held 2.920s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Snapshots deleted, issuing volume delete {{(pid=86082) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 17 15:01:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "cinder-quobyte-807a8bf8-eccc-4712-9322-778df4e65d57" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-807a8bf8-eccc-4712-9322-778df4e65d57" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:29 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[413defa8-84aa-4dda-80d2-82940a1a7cac]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:30 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57 Sep 17 15:01:30 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:30 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57" returned: 0 in 0.624s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:30 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57 Sep 17 15:01:30 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:30 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-807a8bf8-eccc-4712-9322-778df4e65d57" returned: 0 in 0.398s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-807a8bf8-eccc-4712-9322-778df4e65d57" released by "delete_volume" :: held 1.113s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:31 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Created reservations ['3fac52b3-554a-42b4-8d6c-3dff606d425c', '61aefc91-e16d-42a4-9681-18d337d05a25', '9e72adb6-7f96-4f4b-b217-b6920f378b5f', '0241d4b5-c101-404e-957c-334829c12747'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:01:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:31 devstack sudo[92893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:01:31 devstack sudo[92893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:31 devstack sudo[92893]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.361s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:31 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:01:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Deleted volume successfully. Sep 17 15:01:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-db63320e-8366-440e-ac18-aeaf99d916ff tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-807a8bf8-eccc-4712-9322-778df4e65d57-delete_volume" released by "delete_volume" :: held 10.357s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Flow 'volume_create_manager' (1b5c9e4f-cde7-4815-8f63-53e031b5f26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda2b8f2-6684-4779-8cf1-6b7a91c83395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda2b8f2-6684-4779-8cf1-6b7a91c83395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-536478252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0c8c93-ac24-4c6c-9eef-23e78ea9c930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4428f346e9442bd807348db45f6696e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:33Z,use_quota=True,user_id='50c03e222bbf4910b8299f2f74856f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba012ad6-f5a4-4b52-8b9e-9e52e288458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba012ad6-f5a4-4b52-8b9e-9e52e288458c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33f14d6-4c8d-427a-9c3c-cac761002324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33f14d6-4c8d-427a-9c3c-cac761002324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a0c8c93-ac24-4c6c-9eef-23e78ea9c930', 'volume_name': 'volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1982a86-47b7-41f4-80fc-aaa67aaa215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1982a86-47b7-41f4-80fc-aaa67aaa215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8dda9c0-7bd4-48cb-853c-2dfd603df5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:32 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Volume 7a0c8c93-ac24-4c6c-9eef-23e78ea9c930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930', 'volume_size': 1} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-536478252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0c8c93-ac24-4c6c-9eef-23e78ea9c930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4428f346e9442bd807348db45f6696e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:33Z,use_quota=True,user_id='50c03e222bbf4910b8299f2f74856f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Creating volume 7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:01:32 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:01:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:32 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 1073741824 Sep 17 15:01:32 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:33 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 1073741824" returned: 0 in 0.579s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:33 devstack sudo[92902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 Sep 17 15:01:33 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:33 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930" returned: 0 in 0.313s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:01:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8dda9c0-7bd4-48cb-853c-2dfd603df5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1009f01d-2923-4f1b-99fd-7cad49fc7294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:33 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Volume volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 (7a0c8c93-ac24-4c6c-9eef-23e78ea9c930): created successfully Sep 17 15:01:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1009f01d-2923-4f1b-99fd-7cad49fc7294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Flow 'volume_create_manager' (1b5c9e4f-cde7-4815-8f63-53e031b5f26c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7c09784f-4b2d-4a8a-9088-4ab5926a9021 tempest-VolumesDeleteCascade-1663895352 None] Created volume successfully. Sep 17 15:01:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] Creating offline snapshot aedab966-bcbd-4d6d-a41e-d557f887d7ea of volume 7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:01:35 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[582a7f35-3851-461e-af6f-8f08c5538e1c]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:35 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 Sep 17 15:01:35 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:35 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930" returned: 0 in 0.425s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:35 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea 1G Sep 17 15:01:35 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:35 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea 1G" returned: 0 in 0.460s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:35 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea Sep 17 15:01:35 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:36 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea" returned: 0 in 0.366s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:36 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea is being set with open permissions: ugo+rw Sep 17 15:01:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:36 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea Sep 17 15:01:36 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:36 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea" returned: 0 in 0.286s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:36 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.info Sep 17 15:01:36 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:36 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.info" returned: 0 in 0.281s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:36 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.info is being set with open permissions: ugo+rw Sep 17 15:01:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:36 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.info Sep 17 15:01:36 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:37 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.info" returned: 0 in 0.293s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.239s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b08d3c15-dd77-49ac-b09b-4f2d3d7fa6f9 tempest-VolumesDeleteCascade-1663895352 None] Create snapshot completed successfully Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Flow 'volume_create_manager' (f81c7483-f3c0-4d24-a7c5-2cdf89d3fa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0e92c3-c040-4ab8-81c0-cccbbba6a312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de0e92c3-c040-4ab8-81c0-cccbbba6a312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1013897506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed571b6-c58c-404c-b619-9e22df8fdb83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4428f346e9442bd807348db45f6696e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aedab966-bcbd-4d6d-a41e-d557f887d7ea,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:39Z,use_quota=True,user_id='50c03e222bbf4910b8299f2f74856f32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c298f290-8756-4dea-ad27-baed1ed9df80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c298f290-8756-4dea-ad27-baed1ed9df80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5702e74-a377-49eb-ba66-7f2255f7b4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5702e74-a377-49eb-ba66-7f2255f7b4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9ed571b6-c58c-404c-b619-9e22df8fdb83', 'volume_name': 'volume-9ed571b6-c58c-404c-b619-9e22df8fdb83', 'volume_size': 1, 'snapshot_id': 'aedab966-bcbd-4d6d-a41e-d557f887d7ea'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5407bf7-3247-4e5e-a1f6-afe5997e4f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5407bf7-3247-4e5e-a1f6-afe5997e4f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72eb5d63-1044-404a-a35d-e9fec1500d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:39 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Volume 9ed571b6-c58c-404c-b619-9e22df8fdb83: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9ed571b6-c58c-404c-b619-9e22df8fdb83', 'volume_size': 1, 'snapshot_id': 'aedab966-bcbd-4d6d-a41e-d557f887d7ea'} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "cinder-quobyte-aedab966-bcbd-4d6d-a41e-d557f887d7ea-9ed571b6-c58c-404c-b619-9e22df8fdb83" by "_create_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-aedab966-bcbd-4d6d-a41e-d557f887d7ea-9ed571b6-c58c-404c-b619-9e22df8fdb83" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Creating volume 9ed571b6-c58c-404c-b619-9e22df8fdb83 from snapshot aedab966-bcbd-4d6d-a41e-d557f887d7ea {{(pid=86082) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "cinder-quobyte-9ed571b6-c58c-404c-b619-9e22df8fdb83" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-9ed571b6-c58c-404c-b619-9e22df8fdb83" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] snapshot: aedab966-bcbd-4d6d-a41e-d557f887d7ea, volume: 9ed571b6-c58c-404c-b619-9e22df8fdb83, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bb97c9-62de-436c-b044-b9dc8f2ade6e]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:39 devstack sudo[92952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea Sep 17 15:01:39 devstack sudo[92952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:39 devstack sudo[92952]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea" returned: 0 in 0.487s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[967466d0-bad5-425c-ae46-f406a30bbf80]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:40 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 Sep 17 15:01:40 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:01:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:40 devstack sudo[92959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:01:40 devstack sudo[92959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:40 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930" returned: 0 in 0.698s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:01:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:01:40 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Path /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ed571b6-c58c-404c-b619-9e22df8fdb83 not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:01:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ed571b6-c58c-404c-b619-9e22df8fdb83 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:40 devstack sudo[92968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ed571b6-c58c-404c-b619-9e22df8fdb83 Sep 17 15:01:40 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:40 devstack sudo[92959]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.336s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:01:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:01:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:01:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:01:46 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:01:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Flow 'volume_create_manager' (6cea6891-c9e0-4453-b815-02ac633dec16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e576de1f-cd3e-4701-94e0-c3c40f61f905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e576de1f-cd3e-4701-94e0-c3c40f61f905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1687840455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a422c8-1305-4853-9ded-dc8f9b7c4131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffb7cf2144c94d5fbc0925564117ed45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:46Z,use_quota=True,user_id='8d3785d8f6ad468f94195c9a8e6c8063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d50ce89-4bc4-4ec2-97d2-0161f1cef425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d50ce89-4bc4-4ec2-97d2-0161f1cef425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fed9af-fd36-4388-b898-d54ecbe9d921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fed9af-fd36-4388-b898-d54ecbe9d921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a422c8-1305-4853-9ded-dc8f9b7c4131', 'volume_name': 'volume-e3a422c8-1305-4853-9ded-dc8f9b7c4131', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c698c5af-bf6a-46ee-acdf-0cb5773b588a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c698c5af-bf6a-46ee-acdf-0cb5773b588a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8058f5f6-a595-4762-830b-7f6d38536964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:46 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Volume e3a422c8-1305-4853-9ded-dc8f9b7c4131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a422c8-1305-4853-9ded-dc8f9b7c4131', 'volume_size': 1} Sep 17 15:01:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:52 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ed571b6-c58c-404c-b619-9e22df8fdb83" returned: 0 in 11.742s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Image conversion details: src /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930, size 1024.00 MB, duration 11.74 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ed571b6-c58c-404c-b619-9e22df8fdb83 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:01:52 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Converted 1024.00 MB image at 87.20 MB/s Sep 17 15:01:52 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ed571b6-c58c-404c-b619-9e22df8fdb83 is being set with open permissions: ugo+rw Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ed571b6-c58c-404c-b619-9e22df8fdb83 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:52 devstack sudo[93077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ed571b6-c58c-404c-b619-9e22df8fdb83 Sep 17 15:01:52 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:52 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ed571b6-c58c-404c-b619-9e22df8fdb83" returned: 0 in 0.254s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-9ed571b6-c58c-404c-b619-9e22df8fdb83" released by "_copy_volume_from_snapshot" :: held 13.320s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-aedab966-bcbd-4d6d-a41e-d557f887d7ea-9ed571b6-c58c-404c-b619-9e22df8fdb83" released by "_create_volume_from_snapshot" :: held 13.415s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.440s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.170s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1687840455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a422c8-1305-4853-9ded-dc8f9b7c4131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffb7cf2144c94d5fbc0925564117ed45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:46Z,use_quota=True,user_id='8d3785d8f6ad468f94195c9a8e6c8063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Creating volume e3a422c8-1305-4853-9ded-dc8f9b7c4131 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:01:52 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3a422c8-1305-4853-9ded-dc8f9b7c4131 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:52 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3a422c8-1305-4853-9ded-dc8f9b7c4131 1073741824 Sep 17 15:01:52 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72eb5d63-1044-404a-a35d-e9fec1500d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed571b6-c58c-404c-b619-9e22df8fdb83', 'volume_size': 1, 'snapshot_id': 'aedab966-bcbd-4d6d-a41e-d557f887d7ea'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4811fb4-1967-47e4-a41a-6cd6812ea3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:52 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Volume volume-9ed571b6-c58c-404c-b619-9e22df8fdb83 (9ed571b6-c58c-404c-b619-9e22df8fdb83): created successfully Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4811fb4-1967-47e4-a41a-6cd6812ea3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Flow 'volume_create_manager' (f81c7483-f3c0-4d24-a7c5-2cdf89d3fa5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e50855e5-3fd4-4f0e-810a-ca99c423a956 tempest-VolumesDeleteCascade-1663895352 None] Created volume successfully. Sep 17 15:01:53 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3a422c8-1305-4853-9ded-dc8f9b7c4131 1073741824" returned: 0 in 0.556s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3a422c8-1305-4853-9ded-dc8f9b7c4131 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:53 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3a422c8-1305-4853-9ded-dc8f9b7c4131 Sep 17 15:01:53 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "cinder-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Performing cascade delete. {{(pid=86082) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "cinder-aedab966-bcbd-4d6d-a41e-d557f887d7ea-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-aedab966-bcbd-4d6d-a41e-d557f887d7ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "cinder-quobyte-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "cinder-quobyte-aedab966-bcbd-4d6d-a41e-d557f887d7ea" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-aedab966-bcbd-4d6d-a41e-d557f887d7ea" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Deleting offline snapshot aedab966-bcbd-4d6d-a41e-d557f887d7ea of volume 7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] snapshot_file for this snap is: volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b29efe-7c55-483e-9adb-1701de0efa6c]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:53 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3a422c8-1305-4853-9ded-dc8f9b7c4131" returned: 0 in 0.333s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8058f5f6-a595-4762-830b-7f6d38536964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a422c8-1305-4853-9ded-dc8f9b7c4131', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ae247a-a4b1-464f-9878-73aa12664aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:53 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Volume volume-e3a422c8-1305-4853-9ded-dc8f9b7c4131 (e3a422c8-1305-4853-9ded-dc8f9b7c4131): created successfully Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ae247a-a4b1-464f-9878-73aa12664aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Flow 'volume_create_manager' (6cea6891-c9e0-4453-b815-02ac633dec16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b1f5e7bf-9ee3-4790-b753-922e246691de tempest-AttachVolumeNegativeTest-2049608112 None] Created volume successfully. Sep 17 15:01:53 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea Sep 17 15:01:53 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:54 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea" returned: 0 in 0.437s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:01:54 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dd6d0b-a204-4303-a389-d9c4d1bb6d49]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:54 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 Sep 17 15:01:54 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:54 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930" returned: 0 in 0.823s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:55 devstack sudo[93113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea Sep 17 15:01:55 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-ed00ff9f-0246-47d3-81a8-f54dec8e6ccc req-c1f67f0a-a6a6-4995-8645-833fd0f69516 tempest-AttachVolumeNegativeTest-2049608112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-ed00ff9f-0246-47d3-81a8-f54dec8e6ccc req-c1f67f0a-a6a6-4995-8645-833fd0f69516 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-ed00ff9f-0246-47d3-81a8-f54dec8e6ccc req-c1f67f0a-a6a6-4995-8645-833fd0f69516 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-ed00ff9f-0246-47d3-81a8-f54dec8e6ccc req-c1f67f0a-a6a6-4995-8645-833fd0f69516 tempest-AttachVolumeNegativeTest-2049608112 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-e3a422c8-1305-4853-9ded-dc8f9b7c4131', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b1ad01a-7c5b-4091-9d11-78c14d8a734d', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:01:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-ed00ff9f-0246-47d3-81a8-f54dec8e6ccc req-c1f67f0a-a6a6-4995-8645-833fd0f69516 tempest-AttachVolumeNegativeTest-2049608112 None] attachment_update completed successfully. Sep 17 15:01:55 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea" returned: 0 in 0.429s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:55 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea Sep 17 15:01:55 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:55 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930.aedab966-bcbd-4d6d-a41e-d557f887d7ea" returned: 0 in 0.358s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-aedab966-bcbd-4d6d-a41e-d557f887d7ea" released by "_delete_snapshot" :: held 2.203s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930" released by "delete_snapshot" :: held 2.237s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:55 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Created reservations ['59416279-04d4-4fb9-bc62-cb3325e8ee13', '2134b4cd-5632-421c-a766-b425551db9e7', 'f9a46b4c-cb0f-478c-be1f-7b596947384b', '1cafaab3-ce4a-4821-a066-ac69697041fd'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:01:56 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Delete snapshot completed successfully. Sep 17 15:01:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-aedab966-bcbd-4d6d-a41e-d557f887d7ea-delete_snapshot" released by "delete_snapshot" :: held 2.431s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Snapshots deleted, issuing volume delete {{(pid=86082) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 17 15:01:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "cinder-quobyte-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:56 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4455a6-5cfb-4054-9f00-0bc8fb78b9e0]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:56 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 Sep 17 15:01:56 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:56 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930" returned: 0 in 0.489s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:56 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930 Sep 17 15:01:56 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:56 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930" returned: 0 in 0.313s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930" released by "delete_volume" :: held 0.939s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Created reservations ['a5924bf1-f519-4941-97d9-26c4a430f5d3', 'b00a3e1a-e465-46c9-b39a-23772ee955c6', '27c47a72-279c-48da-beb9-639c88dac9f0', 'b6480e62-5905-4b2d-9105-f7ae6acfb979'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:57 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:01:57 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:57 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.379s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:01:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Deleted volume successfully. Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0cb20ecb-fca2-4675-af87-497bfb5ee752 tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-7a0c8c93-ac24-4c6c-9eef-23e78ea9c930-delete_volume" released by "delete_volume" :: held 4.081s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Flow 'volume_create_manager' (fb69d9ba-4d57-4149-86c6-64a289670c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2603fcad-8da8-4f42-b6a4-32bb6bce4a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2603fcad-8da8-4f42-b6a4-32bb6bce4a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1520089584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f72ab8da-97a4-40cd-b32d-f16ab7579ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ac52718ec234c5194812e65d74b67d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:58Z,use_quota=True,user_id='7509ea06875b46d08b6b2f23f8130911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e324c1-c3fb-44bf-b71b-372bab041be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e324c1-c3fb-44bf-b71b-372bab041be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0840e5f4-8b17-4f2d-b2c4-0674cb7fd6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0840e5f4-8b17-4f2d-b2c4-0674cb7fd6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f72ab8da-97a4-40cd-b32d-f16ab7579ecc', 'volume_name': 'volume-f72ab8da-97a4-40cd-b32d-f16ab7579ecc', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56790d5a-d205-46aa-bd0f-5dfb5a11adf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56790d5a-d205-46aa-bd0f-5dfb5a11adf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f26528-1a64-413a-8f3a-469006c04d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:57 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Volume f72ab8da-97a4-40cd-b32d-f16ab7579ecc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f72ab8da-97a4-40cd-b32d-f16ab7579ecc', 'volume_size': 1} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1520089584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f72ab8da-97a4-40cd-b32d-f16ab7579ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ac52718ec234c5194812e65d74b67d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:58Z,use_quota=True,user_id='7509ea06875b46d08b6b2f23f8130911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Creating volume f72ab8da-97a4-40cd-b32d-f16ab7579ecc {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:01:57 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:01:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f72ab8da-97a4-40cd-b32d-f16ab7579ecc 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:57 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f72ab8da-97a4-40cd-b32d-f16ab7579ecc 1073741824 Sep 17 15:01:57 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "cinder-9ed571b6-c58c-404c-b619-9e22df8fdb83-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-9ed571b6-c58c-404c-b619-9e22df8fdb83-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "cinder-quobyte-9ed571b6-c58c-404c-b619-9e22df8fdb83" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-9ed571b6-c58c-404c-b619-9e22df8fdb83" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[368bba9b-b5f1-43a8-835a-c263adbc6486]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ed571b6-c58c-404c-b619-9e22df8fdb83 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:58 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ed571b6-c58c-404c-b619-9e22df8fdb83 Sep 17 15:01:58 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:58 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f72ab8da-97a4-40cd-b32d-f16ab7579ecc 1073741824" returned: 0 in 0.564s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f72ab8da-97a4-40cd-b32d-f16ab7579ecc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:58 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f72ab8da-97a4-40cd-b32d-f16ab7579ecc Sep 17 15:01:58 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:58 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ed571b6-c58c-404c-b619-9e22df8fdb83" returned: 0 in 0.449s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ed571b6-c58c-404c-b619-9e22df8fdb83 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:58 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f72ab8da-97a4-40cd-b32d-f16ab7579ecc" returned: 0 in 0.291s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:58 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ed571b6-c58c-404c-b619-9e22df8fdb83 Sep 17 15:01:58 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f26528-1a64-413a-8f3a-469006c04d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f72ab8da-97a4-40cd-b32d-f16ab7579ecc', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd9e987-edbe-4ab1-b3d9-e59c7ecd68dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:58 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Volume volume-f72ab8da-97a4-40cd-b32d-f16ab7579ecc (f72ab8da-97a4-40cd-b32d-f16ab7579ecc): created successfully Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd9e987-edbe-4ab1-b3d9-e59c7ecd68dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Flow 'volume_create_manager' (fb69d9ba-4d57-4149-86c6-64a289670c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:58 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5596cafa-b9eb-4d8d-9cf9-76dbb895aa10 tempest-VolumesTransfersV355Test-1808507521 None] Created volume successfully. Sep 17 15:01:58 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ed571b6-c58c-404c-b619-9e22df8fdb83" returned: 0 in 0.284s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-quobyte-9ed571b6-c58c-404c-b619-9e22df8fdb83" released by "delete_volume" :: held 0.785s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:58 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] Created reservations ['7ac4f287-f42d-4dd5-981c-94faa6f8c30e', 'f338d8b4-61e6-4285-91b7-c28242834148', 'ad1c5f4d-9555-457e-8c9e-8622aed81ce1', '070dbd4f-a102-47f6-8d5a-3099421a4965'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:01:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:59 devstack sudo[93586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:01:59 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:59 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.272s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:59 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:01:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] Deleted volume successfully. Sep 17 15:01:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c374952b-86cf-4603-a57e-921bded8b47d tempest-VolumesDeleteCascade-1663895352 None] Lock "cinder-9ed571b6-c58c-404c-b619-9e22df8fdb83-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-34c380a0-3d13-4292-893e-fb2147f04ec9 tempest-VolumesTransfersV355Test-646653310 None] Transfer volume completed successfully. Sep 17 15:02:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] Acquiring lock "cinder-f72ab8da-97a4-40cd-b32d-f16ab7579ecc-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] Lock "cinder-f72ab8da-97a4-40cd-b32d-f16ab7579ecc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] Acquiring lock "cinder-quobyte-f72ab8da-97a4-40cd-b32d-f16ab7579ecc" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] Lock "cinder-quobyte-f72ab8da-97a4-40cd-b32d-f16ab7579ecc" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:01 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0658eadd-145f-4761-8337-3fb9bb14fe95]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f72ab8da-97a4-40cd-b32d-f16ab7579ecc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:01 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f72ab8da-97a4-40cd-b32d-f16ab7579ecc Sep 17 15:02:01 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:02 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f72ab8da-97a4-40cd-b32d-f16ab7579ecc" returned: 0 in 0.486s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f72ab8da-97a4-40cd-b32d-f16ab7579ecc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:02 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f72ab8da-97a4-40cd-b32d-f16ab7579ecc Sep 17 15:02:02 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:02 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f72ab8da-97a4-40cd-b32d-f16ab7579ecc" returned: 0 in 0.322s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] Lock "cinder-quobyte-f72ab8da-97a4-40cd-b32d-f16ab7579ecc" released by "delete_volume" :: held 0.879s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:02 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] Created reservations ['76a93cba-53cb-402e-8fea-ef104f3e9c50', '9849520e-713e-4f92-8c95-282c5aae27e4', '957ce6be-f2c9-481c-bc5c-f1722dfb0d19', '4c9cae1a-e21d-4dae-a1bd-f96208656573'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:02 devstack sudo[93608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:02:02 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:03 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.443s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] Deleted volume successfully. Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8640aa27-30b5-48d7-a992-a0eaecbb89e4 tempest-VolumesTransfersV355Test-1083610788 None] Lock "cinder-f72ab8da-97a4-40cd-b32d-f16ab7579ecc-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Flow 'volume_create_manager' (c02a0687-9e75-4e44-9707-b5640d71e455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c9b6c8-613e-46d1-a9dd-cce14b009ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c9b6c8-613e-46d1-a9dd-cce14b009ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1811074588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33648d41-77ae-49d5-83d5-03891485e0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ac52718ec234c5194812e65d74b67d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:03Z,use_quota=True,user_id='7509ea06875b46d08b6b2f23f8130911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ab9bee-500a-4a63-96c1-8c35ab2a5ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1ab9bee-500a-4a63-96c1-8c35ab2a5ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab64328-3d40-49d5-bcd8-949fca6fa3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab64328-3d40-49d5-bcd8-949fca6fa3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33648d41-77ae-49d5-83d5-03891485e0c7', 'volume_name': 'volume-33648d41-77ae-49d5-83d5-03891485e0c7', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b97fdf-3dd4-4636-8f73-0894e08c9566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b97fdf-3dd4-4636-8f73-0894e08c9566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6fa337-49d3-4da7-819a-393d397f2da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:03 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Volume 33648d41-77ae-49d5-83d5-03891485e0c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33648d41-77ae-49d5-83d5-03891485e0c7', 'volume_size': 1} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1811074588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33648d41-77ae-49d5-83d5-03891485e0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ac52718ec234c5194812e65d74b67d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:03Z,use_quota=True,user_id='7509ea06875b46d08b6b2f23f8130911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Creating volume 33648d41-77ae-49d5-83d5-03891485e0c7 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:03 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:02:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-33648d41-77ae-49d5-83d5-03891485e0c7 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:03 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-33648d41-77ae-49d5-83d5-03891485e0c7 1073741824 Sep 17 15:02:03 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:04 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-33648d41-77ae-49d5-83d5-03891485e0c7 1073741824" returned: 0 in 0.595s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-33648d41-77ae-49d5-83d5-03891485e0c7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:04 devstack sudo[93626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-33648d41-77ae-49d5-83d5-03891485e0c7 Sep 17 15:02:04 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Flow 'volume_create_manager' (761da72e-7722-450e-bb67-2461b54bd5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c24985d-cc42-4425-9254-1df08bf773ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c24985d-cc42-4425-9254-1df08bf773ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1925525977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e652f31-f9e5-4833-894c-22defc3e2687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f08b98edc6475cb37bb619220dfed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:04Z,use_quota=True,user_id='25d5e3299add4c38b25e404f348eed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb1d53c-4c37-4777-9a23-a1b0b6150b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb1d53c-4c37-4777-9a23-a1b0b6150b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8dc62ab-70c8-432b-91a3-a0879f65d9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8dc62ab-70c8-432b-91a3-a0879f65d9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e652f31-f9e5-4833-894c-22defc3e2687', 'volume_name': 'volume-8e652f31-f9e5-4833-894c-22defc3e2687', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3c8275-82ec-48fc-a0a2-998f47a69127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3c8275-82ec-48fc-a0a2-998f47a69127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03152c76-ebf6-487f-b4cb-7141f92709a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:04 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Volume 8e652f31-f9e5-4833-894c-22defc3e2687: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e652f31-f9e5-4833-894c-22defc3e2687', 'volume_size': 1} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:04 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-33648d41-77ae-49d5-83d5-03891485e0c7" returned: 0 in 0.481s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.311s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1925525977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e652f31-f9e5-4833-894c-22defc3e2687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8f08b98edc6475cb37bb619220dfed9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:04Z,use_quota=True,user_id='25d5e3299add4c38b25e404f348eed68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Creating volume 8e652f31-f9e5-4833-894c-22defc3e2687 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:04 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8e652f31-f9e5-4833-894c-22defc3e2687 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6fa337-49d3-4da7-819a-393d397f2da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33648d41-77ae-49d5-83d5-03891485e0c7', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafb4392-06cf-4755-a653-cd7b6fdcd73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:04 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8e652f31-f9e5-4833-894c-22defc3e2687 1073741824 Sep 17 15:02:04 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:04 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Volume volume-33648d41-77ae-49d5-83d5-03891485e0c7 (33648d41-77ae-49d5-83d5-03891485e0c7): created successfully Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eafb4392-06cf-4755-a653-cd7b6fdcd73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Flow 'volume_create_manager' (c02a0687-9e75-4e44-9707-b5640d71e455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:04 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5ee3dc22-6f04-4b50-b5ac-77b4cb579d3d tempest-VolumesTransfersV355Test-1808507521 None] Created volume successfully. Sep 17 15:02:05 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8e652f31-f9e5-4833-894c-22defc3e2687 1073741824" returned: 0 in 0.748s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8e652f31-f9e5-4833-894c-22defc3e2687 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:05 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8e652f31-f9e5-4833-894c-22defc3e2687 Sep 17 15:02:05 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:06 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8e652f31-f9e5-4833-894c-22defc3e2687" returned: 0 in 0.702s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03152c76-ebf6-487f-b4cb-7141f92709a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e652f31-f9e5-4833-894c-22defc3e2687', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a34ed6-fd1b-4789-a85e-9b381e78de3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:06 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Volume volume-8e652f31-f9e5-4833-894c-22defc3e2687 (8e652f31-f9e5-4833-894c-22defc3e2687): created successfully Sep 17 15:02:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a34ed6-fd1b-4789-a85e-9b381e78de3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Flow 'volume_create_manager' (761da72e-7722-450e-bb67-2461b54bd5b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:06 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-551b20fc-dde8-4da3-b014-8149f0692f77 tempest-VolumesMetadataTest-218499104 None] Created volume successfully. Sep 17 15:02:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] Acquiring lock "cinder-33648d41-77ae-49d5-83d5-03891485e0c7-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] Lock "cinder-33648d41-77ae-49d5-83d5-03891485e0c7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] Acquiring lock "cinder-quobyte-33648d41-77ae-49d5-83d5-03891485e0c7" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] Lock "cinder-quobyte-33648d41-77ae-49d5-83d5-03891485e0c7" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2537ad-0d20-4146-9407-7a27a55546c3]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-33648d41-77ae-49d5-83d5-03891485e0c7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:06 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-33648d41-77ae-49d5-83d5-03891485e0c7 Sep 17 15:02:06 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:07 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-33648d41-77ae-49d5-83d5-03891485e0c7" returned: 0 in 0.474s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-33648d41-77ae-49d5-83d5-03891485e0c7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:07 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-33648d41-77ae-49d5-83d5-03891485e0c7 Sep 17 15:02:07 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:07 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-33648d41-77ae-49d5-83d5-03891485e0c7" returned: 0 in 0.332s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] Lock "cinder-quobyte-33648d41-77ae-49d5-83d5-03891485e0c7" released by "delete_volume" :: held 0.867s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:07 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] Created reservations ['7d6013c5-5992-4892-b328-e8e9c109d7ad', '4055288d-54a3-4ce3-aa9f-47f8f817649d', 'b040f1e1-c0b3-4379-8904-6a17e76c62a5', '821dfc86-772d-4caa-9a09-f4d8f9aa110a'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:07 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:02:07 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:08 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.419s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:08 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:08 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] Deleted volume successfully. Sep 17 15:02:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e3465d2d-df2d-4d4c-a1ce-be8a9c1247e4 tempest-VolumesTransfersV355Test-1083610788 None] Lock "cinder-33648d41-77ae-49d5-83d5-03891485e0c7-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] Acquiring lock "cinder-8e652f31-f9e5-4833-894c-22defc3e2687-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] Lock "cinder-8e652f31-f9e5-4833-894c-22defc3e2687-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] Acquiring lock "cinder-quobyte-8e652f31-f9e5-4833-894c-22defc3e2687" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] Lock "cinder-quobyte-8e652f31-f9e5-4833-894c-22defc3e2687" acquired by "delete_volume" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:08 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e095cf3-e7bf-4fda-b210-ecce5b7ad3b8]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8e652f31-f9e5-4833-894c-22defc3e2687 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:09 devstack sudo[93732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8e652f31-f9e5-4833-894c-22defc3e2687 Sep 17 15:02:09 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:09 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8e652f31-f9e5-4833-894c-22defc3e2687" returned: 0 in 0.577s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8e652f31-f9e5-4833-894c-22defc3e2687 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:09 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8e652f31-f9e5-4833-894c-22defc3e2687 Sep 17 15:02:09 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:09 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8e652f31-f9e5-4833-894c-22defc3e2687" returned: 0 in 0.367s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] Lock "cinder-quobyte-8e652f31-f9e5-4833-894c-22defc3e2687" released by "delete_volume" :: held 1.022s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:09 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=109,cinder:SELECT=97,cinder:DELETE=7,cinder:INSERT=30 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:02:09 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] Created reservations ['a536c452-39bd-4433-b257-1a1b9b43b092', '7381d4bf-b4f7-4d94-99aa-54bd5239fc11', '6824add3-76d0-4ea5-9ac5-f867d94b6c83', 'd449d042-e3db-48b9-8635-02f551093320'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:10 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:02:10 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:10 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.372s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:10 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] Deleted volume successfully. Sep 17 15:02:10 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=93,cinder:UPDATE=114,cinder:INSERT=25,cinder:DELETE=9 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:02:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-70c70a8c-a560-4095-835e-d88c29a65ba5 tempest-VolumesMetadataTest-218499104 None] Lock "cinder-8e652f31-f9e5-4833-894c-22defc3e2687-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Flow 'volume_create_manager' (dacd98f2-5fb9-4cd5-8788-709f9228ef7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31b115c-e23b-4b36-afbc-90ded1c0ca28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d31b115c-e23b-4b36-afbc-90ded1c0ca28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-433984113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5373ff8d-9374-4f47-b063-2ac7890e5645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702761bd88a04be3a8795835728b3b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:11Z,use_quota=True,user_id='0910924715294b9fbb7a7d05f84f636b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e3358a-6d6d-419c-adc7-e748180992d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e3358a-6d6d-419c-adc7-e748180992d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e05ad9-7a4b-4ea2-813e-efacf7d28b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e05ad9-7a4b-4ea2-813e-efacf7d28b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5373ff8d-9374-4f47-b063-2ac7890e5645', 'volume_name': 'volume-5373ff8d-9374-4f47-b063-2ac7890e5645', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15de96b-5cc7-4a45-a06b-fc96d87860a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b15de96b-5cc7-4a45-a06b-fc96d87860a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b09edd-9cbf-4864-932a-06a40557e507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:11 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Volume 5373ff8d-9374-4f47-b063-2ac7890e5645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5373ff8d-9374-4f47-b063-2ac7890e5645', 'volume_size': 1} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-433984113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5373ff8d-9374-4f47-b063-2ac7890e5645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='702761bd88a04be3a8795835728b3b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:11Z,use_quota=True,user_id='0910924715294b9fbb7a7d05f84f636b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Creating volume 5373ff8d-9374-4f47-b063-2ac7890e5645 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:11 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5373ff8d-9374-4f47-b063-2ac7890e5645 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:11 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5373ff8d-9374-4f47-b063-2ac7890e5645 1073741824 Sep 17 15:02:11 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:11 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5373ff8d-9374-4f47-b063-2ac7890e5645 1073741824" returned: 0 in 0.630s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5373ff8d-9374-4f47-b063-2ac7890e5645 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:11 devstack sudo[93753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5373ff8d-9374-4f47-b063-2ac7890e5645 Sep 17 15:02:11 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:12 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5373ff8d-9374-4f47-b063-2ac7890e5645" returned: 0 in 0.369s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b09edd-9cbf-4864-932a-06a40557e507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5373ff8d-9374-4f47-b063-2ac7890e5645', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41522197-fc7f-4884-a644-6fc2cc077221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:12 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Volume volume-5373ff8d-9374-4f47-b063-2ac7890e5645 (5373ff8d-9374-4f47-b063-2ac7890e5645): created successfully Sep 17 15:02:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41522197-fc7f-4884-a644-6fc2cc077221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Flow 'volume_create_manager' (dacd98f2-5fb9-4cd5-8788-709f9228ef7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:12 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7afe463d-e34c-42f6-9fb2-1f62f38f430a tempest-AttachVolumeShelveTestJSON-1164365962 None] Created volume successfully. Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Flow 'volume_create_manager' (dd7b4d2b-c97d-42db-869c-923081ab4cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492bdb8c-effb-4948-abeb-808170ddafa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492bdb8c-effb-4948-abeb-808170ddafa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-590738373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd89418-2d47-4961-ad00-c017851590a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5180713a09b24630b368c117bc68818f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:19Z,use_quota=True,user_id='7b48a295cb834b3f9b09a92ca9e60cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9d7003-727c-4281-a9d1-9f1a1aa80506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9d7003-727c-4281-a9d1-9f1a1aa80506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d7d7e5-5406-4e95-a00d-c63012f94968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d7d7e5-5406-4e95-a00d-c63012f94968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dd89418-2d47-4961-ad00-c017851590a1', 'volume_name': 'volume-2dd89418-2d47-4961-ad00-c017851590a1', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2319de67-0e60-4a30-ab97-681d9cdafe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2319de67-0e60-4a30-ab97-681d9cdafe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3474a386-5705-402d-b84c-fa880e561c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:18 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Volume 2dd89418-2d47-4961-ad00-c017851590a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dd89418-2d47-4961-ad00-c017851590a1', 'volume_size': 1} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-590738373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd89418-2d47-4961-ad00-c017851590a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5180713a09b24630b368c117bc68818f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:19Z,use_quota=True,user_id='7b48a295cb834b3f9b09a92ca9e60cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Creating volume 2dd89418-2d47-4961-ad00-c017851590a1 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:18 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:02:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2dd89418-2d47-4961-ad00-c017851590a1 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:18 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2dd89418-2d47-4961-ad00-c017851590a1 1073741824 Sep 17 15:02:18 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:19 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2dd89418-2d47-4961-ad00-c017851590a1 1073741824" returned: 0 in 0.845s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2dd89418-2d47-4961-ad00-c017851590a1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:19 devstack sudo[93830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2dd89418-2d47-4961-ad00-c017851590a1 Sep 17 15:02:19 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:20 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2dd89418-2d47-4961-ad00-c017851590a1" returned: 0 in 0.308s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3474a386-5705-402d-b84c-fa880e561c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dd89418-2d47-4961-ad00-c017851590a1', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f5c921-a5f7-41ac-b4bd-65918468af7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Flow 'volume_create_manager' (ac28c8d7-3270-4d12-b14c-24e711d6c838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4ea6a9-010d-4615-a1bd-6672c2d2d910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:20 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Volume volume-2dd89418-2d47-4961-ad00-c017851590a1 (2dd89418-2d47-4961-ad00-c017851590a1): created successfully Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f5c921-a5f7-41ac-b4bd-65918468af7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Flow 'volume_create_manager' (dd7b4d2b-c97d-42db-869c-923081ab4cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be4ea6a9-010d-4615-a1bd-6672c2d2d910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-783295524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88114bd1-28c3-4723-9983-1f396a2db9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1576fb3925746ae9636481970a7ba42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:20Z,use_quota=True,user_id='c185b25a06eb44c2b2585bf2f1b2bca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a1d9bc-bdee-468e-86a5-51d4c5caa8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a1d9bc-bdee-468e-86a5-51d4c5caa8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f400f55-49e9-45ca-99fb-1d5a5493d523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f400f55-49e9-45ca-99fb-1d5a5493d523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88114bd1-28c3-4723-9983-1f396a2db9be', 'volume_name': 'volume-88114bd1-28c3-4723-9983-1f396a2db9be', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c798cc12-81ec-495c-ad2d-64e079790b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c798cc12-81ec-495c-ad2d-64e079790b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cabc85d-fc59-4230-bc93-a48329c1f671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:20 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Volume 88114bd1-28c3-4723-9983-1f396a2db9be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88114bd1-28c3-4723-9983-1f396a2db9be', 'volume_size': 1} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-783295524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88114bd1-28c3-4723-9983-1f396a2db9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1576fb3925746ae9636481970a7ba42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:20Z,use_quota=True,user_id='c185b25a06eb44c2b2585bf2f1b2bca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Creating volume 88114bd1-28c3-4723-9983-1f396a2db9be {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:20 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-88114bd1-28c3-4723-9983-1f396a2db9be 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:20 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-93b5a0ec-b9f1-45ae-aba9-350c041bc743 tempest-VolumesTransfersTest-367759265 None] Created volume successfully. Sep 17 15:02:20 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-88114bd1-28c3-4723-9983-1f396a2db9be 1073741824 Sep 17 15:02:20 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:20 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-88114bd1-28c3-4723-9983-1f396a2db9be 1073741824" returned: 0 in 0.567s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-88114bd1-28c3-4723-9983-1f396a2db9be {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:20 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-88114bd1-28c3-4723-9983-1f396a2db9be Sep 17 15:02:20 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:21 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-88114bd1-28c3-4723-9983-1f396a2db9be" returned: 0 in 0.277s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cabc85d-fc59-4230-bc93-a48329c1f671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88114bd1-28c3-4723-9983-1f396a2db9be', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076edb75-b267-4892-81b0-91ad8ea17057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:21 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Volume volume-88114bd1-28c3-4723-9983-1f396a2db9be (88114bd1-28c3-4723-9983-1f396a2db9be): created successfully Sep 17 15:02:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076edb75-b267-4892-81b0-91ad8ea17057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Flow 'volume_create_manager' (ac28c8d7-3270-4d12-b14c-24e711d6c838) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5f4eb125-36d8-4140-bb61-ebcaea72c605 tempest-VolumesTransfersV357Test-1511275060 None] Created volume successfully. Sep 17 15:02:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-873dd24d-84d0-42e5-b96f-6e5c0801f199 tempest-VolumesTransfersTest-333765202 None] Transfer volume completed successfully. Sep 17 15:02:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] Acquiring lock "cinder-2dd89418-2d47-4961-ad00-c017851590a1-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] Lock "cinder-2dd89418-2d47-4961-ad00-c017851590a1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] Acquiring lock "cinder-quobyte-2dd89418-2d47-4961-ad00-c017851590a1" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] Lock "cinder-quobyte-2dd89418-2d47-4961-ad00-c017851590a1" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:22 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a78335-e841-4ad8-849a-7468ec208ff1]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2dd89418-2d47-4961-ad00-c017851590a1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:22 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2dd89418-2d47-4961-ad00-c017851590a1 Sep 17 15:02:22 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:22 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2dd89418-2d47-4961-ad00-c017851590a1" returned: 0 in 0.429s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2dd89418-2d47-4961-ad00-c017851590a1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:22 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2dd89418-2d47-4961-ad00-c017851590a1 Sep 17 15:02:22 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a85665c9-e6e7-4e58-bd01-122ec45ae9c0 tempest-VolumesTransfersV357Test-2080737011 None] Transfer volume completed successfully. Sep 17 15:02:23 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2dd89418-2d47-4961-ad00-c017851590a1" returned: 0 in 0.265s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] Lock "cinder-quobyte-2dd89418-2d47-4961-ad00-c017851590a1" released by "delete_volume" :: held 0.765s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:23 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] Created reservations ['bcecda5a-4110-4e33-ba39-dfc4cb23a25f', 'b04d879a-18ae-42f4-9e77-f0332c87814e', 'b340cc5b-1f1f-4942-96ac-90f0ec2cb090', 'b6a09863-5599-4cad-a999-ec219e770fdc'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:23 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:02:23 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] Acquiring lock "cinder-88114bd1-28c3-4723-9983-1f396a2db9be-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:23 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.278s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:23 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] Lock "cinder-88114bd1-28c3-4723-9983-1f396a2db9be-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] Deleted volume successfully. Sep 17 15:02:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-110c8368-e6a2-4c80-8de0-01d6c040d0ea tempest-VolumesTransfersTest-1850216382 None] Lock "cinder-2dd89418-2d47-4961-ad00-c017851590a1-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] Acquiring lock "cinder-quobyte-88114bd1-28c3-4723-9983-1f396a2db9be" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] Lock "cinder-quobyte-88114bd1-28c3-4723-9983-1f396a2db9be" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:23 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f360e1ed-016b-47c7-8919-07e2c7407242]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-88114bd1-28c3-4723-9983-1f396a2db9be {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:23 devstack sudo[93874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-88114bd1-28c3-4723-9983-1f396a2db9be Sep 17 15:02:23 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:24 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-88114bd1-28c3-4723-9983-1f396a2db9be" returned: 0 in 0.428s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-88114bd1-28c3-4723-9983-1f396a2db9be {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:24 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-88114bd1-28c3-4723-9983-1f396a2db9be Sep 17 15:02:24 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Flow 'volume_create_manager' (1933eea4-4dc3-4e85-ae3a-645765a25d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85385642-5fd6-46dc-a95a-79e0340a337b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85385642-5fd6-46dc-a95a-79e0340a337b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1637785457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d522b1e-25a0-420f-a067-1f3c540c91aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5180713a09b24630b368c117bc68818f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:24Z,use_quota=True,user_id='7b48a295cb834b3f9b09a92ca9e60cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cbcc37a-980c-4890-9d98-e54e0f166cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cbcc37a-980c-4890-9d98-e54e0f166cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c5c511-b331-4e04-9141-18375fc287ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c5c511-b331-4e04-9141-18375fc287ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d522b1e-25a0-420f-a067-1f3c540c91aa', 'volume_name': 'volume-5d522b1e-25a0-420f-a067-1f3c540c91aa', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbaaa9e3-242e-44f3-a3b2-383747465d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbaaa9e3-242e-44f3-a3b2-383747465d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc396ddd-0823-4a8b-b903-a605ad28f964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:24 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Volume 5d522b1e-25a0-420f-a067-1f3c540c91aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d522b1e-25a0-420f-a067-1f3c540c91aa', 'volume_size': 1} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1637785457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d522b1e-25a0-420f-a067-1f3c540c91aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5180713a09b24630b368c117bc68818f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:24Z,use_quota=True,user_id='7b48a295cb834b3f9b09a92ca9e60cb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Creating volume 5d522b1e-25a0-420f-a067-1f3c540c91aa {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:24 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5d522b1e-25a0-420f-a067-1f3c540c91aa 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:24 devstack sudo[93881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5d522b1e-25a0-420f-a067-1f3c540c91aa 1073741824 Sep 17 15:02:24 devstack sudo[93881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:24 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-88114bd1-28c3-4723-9983-1f396a2db9be" returned: 0 in 0.268s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] Lock "cinder-quobyte-88114bd1-28c3-4723-9983-1f396a2db9be" released by "delete_volume" :: held 0.753s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] Created reservations ['5dad898e-5b26-4969-b6c8-2ed7d57f22fe', '2b025265-3c62-473e-8883-b5d36aac268f', 'b4df485a-2794-46b6-ac02-c3f246574f07', '09d81d6a-3d52-41f2-8bd7-baf5a2e36013'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:24 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:02:24 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:24 devstack sudo[93881]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5d522b1e-25a0-420f-a067-1f3c540c91aa 1073741824" returned: 0 in 0.568s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:24 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-fef2e6c3-0f26-488d-875b-0b1e25f1f635 req-e669f186-3759-4f90-8d9e-ceab89779415 tempest-AttachVolumeShelveTestJSON-1164365962 None] No connector for attachment cd4a724f-c71f-4643-b590-b91d3504373e; skipping storage backend terminate_connection call. {{(pid=86082) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-fef2e6c3-0f26-488d-875b-0b1e25f1f635 req-e669f186-3759-4f90-8d9e-ceab89779415 tempest-AttachVolumeShelveTestJSON-1164365962 None] Deleting attachment cd4a724f-c71f-4643-b590-b91d3504373e. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.356s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5d522b1e-25a0-420f-a067-1f3c540c91aa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] Deleted volume successfully. Sep 17 15:02:25 devstack sudo[93890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5d522b1e-25a0-420f-a067-1f3c540c91aa Sep 17 15:02:25 devstack sudo[93890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-33a53e3a-24cb-4aff-8883-4d61b7fc67dc tempest-VolumesTransfersV357Test-449726397 None] Lock "cinder-88114bd1-28c3-4723-9983-1f396a2db9be-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:25 devstack sudo[93890]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5d522b1e-25a0-420f-a067-1f3c540c91aa" returned: 0 in 0.363s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc396ddd-0823-4a8b-b903-a605ad28f964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d522b1e-25a0-420f-a067-1f3c540c91aa', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb536a1f-b2fe-4357-9819-cf12ed5f828e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:25 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Volume volume-5d522b1e-25a0-420f-a067-1f3c540c91aa (5d522b1e-25a0-420f-a067-1f3c540c91aa): created successfully Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb536a1f-b2fe-4357-9819-cf12ed5f828e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Flow 'volume_create_manager' (1933eea4-4dc3-4e85-ae3a-645765a25d3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-777fab80-bdff-4d97-b936-4c548545cea1 tempest-VolumesTransfersTest-367759265 None] Created volume successfully. Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Flow 'volume_create_manager' (2963bacb-9ed1-4665-b4bf-ed94142ead1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabc6f7a-dd06-406b-bd41-af4028df7544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eabc6f7a-dd06-406b-bd41-af4028df7544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-403178611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1576fb3925746ae9636481970a7ba42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:25Z,use_quota=True,user_id='c185b25a06eb44c2b2585bf2f1b2bca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11b3151-8c31-4691-8dec-a95e183e4d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11b3151-8c31-4691-8dec-a95e183e4d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f904d8c1-eb7f-45d0-91c2-ac578c9a848c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f904d8c1-eb7f-45d0-91c2-ac578c9a848c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8', 'volume_name': 'volume-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d8af47-74cc-4a64-b131-f8c481f615cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d8af47-74cc-4a64-b131-f8c481f615cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44850946-8fe7-4d50-810b-625bac326976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:25 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Volume 9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8', 'volume_size': 1} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-403178611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1576fb3925746ae9636481970a7ba42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:25Z,use_quota=True,user_id='c185b25a06eb44c2b2585bf2f1b2bca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Creating volume 9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:25 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:02:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:25 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8 1073741824 Sep 17 15:02:25 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:26 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8 1073741824" returned: 0 in 0.561s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:26 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8 Sep 17 15:02:26 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:26 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8" returned: 0 in 0.369s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44850946-8fe7-4d50-810b-625bac326976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42a70f5-d360-4c23-b2c2-abe004773d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:26 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Volume volume-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8 (9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8): created successfully Sep 17 15:02:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42a70f5-d360-4c23-b2c2-abe004773d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Flow 'volume_create_manager' (2963bacb-9ed1-4665-b4bf-ed94142ead1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-319d99b9-569c-421a-abd6-70bac81ab929 tempest-VolumesTransfersV357Test-1511275060 None] Created volume successfully. Sep 17 15:02:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] Acquiring lock "cinder-5d522b1e-25a0-420f-a067-1f3c540c91aa-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] Lock "cinder-5d522b1e-25a0-420f-a067-1f3c540c91aa-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] Acquiring lock "cinder-quobyte-5d522b1e-25a0-420f-a067-1f3c540c91aa" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] Lock "cinder-quobyte-5d522b1e-25a0-420f-a067-1f3c540c91aa" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:26 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae4736a-8949-446b-aaf9-0305d9af39da]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5d522b1e-25a0-420f-a067-1f3c540c91aa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:27 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5d522b1e-25a0-420f-a067-1f3c540c91aa Sep 17 15:02:27 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:27 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5d522b1e-25a0-420f-a067-1f3c540c91aa" returned: 0 in 0.452s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5d522b1e-25a0-420f-a067-1f3c540c91aa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:27 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5d522b1e-25a0-420f-a067-1f3c540c91aa Sep 17 15:02:27 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:27 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5d522b1e-25a0-420f-a067-1f3c540c91aa" returned: 0 in 0.362s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] Lock "cinder-quobyte-5d522b1e-25a0-420f-a067-1f3c540c91aa" released by "delete_volume" :: held 0.902s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:27 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] Created reservations ['c9add6c2-c992-458f-8e47-d7457f20ec0a', 'a006590d-065c-4bbc-a512-0b7d8de265de', 'a9544038-03e6-4191-8d93-3fe9b5cd1fef', 'dad8aeb2-fbac-4f44-9071-9908c462b774'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:27 devstack sudo[93914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:02:27 devstack sudo[93914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] Acquiring lock "cinder-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] Lock "cinder-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] Acquiring lock "cinder-quobyte-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] Lock "cinder-quobyte-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8" acquired by "delete_volume" :: waited 0.069s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:28 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91852d4-6580-4635-bce4-7fc3290184e6]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:28 devstack sudo[93914]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.494s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:28 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] Deleted volume successfully. Sep 17 15:02:28 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8 Sep 17 15:02:28 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3cbbee80-2d79-4aff-9e29-6714cf4a05d9 tempest-VolumesTransfersTest-1850216382 None] Lock "cinder-5d522b1e-25a0-420f-a067-1f3c540c91aa-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:28 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8" returned: 0 in 0.580s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:28 devstack sudo[93923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8 Sep 17 15:02:28 devstack sudo[93923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:29 devstack sudo[93923]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8" returned: 0 in 0.334s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] Lock "cinder-quobyte-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8" released by "delete_volume" :: held 1.020s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:29 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] Created reservations ['cfcf8b9c-844c-46bd-8b16-423a2ffd405a', '9f4eb9fd-0f32-47da-b556-293d49d10cde', 'a33a3642-b48a-496b-8d95-c114c41f3f58', 'd9af1cf2-6a18-4aaa-b80c-88ea20627432'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:29 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:02:29 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:29 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.315s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:29 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] Deleted volume successfully. Sep 17 15:02:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-06eb1ce4-dea5-4f97-8b7c-c026e1b9e809 tempest-VolumesTransfersV357Test-449726397 None] Lock "cinder-9c4441f5-7680-4cbb-b9ea-bd4008a0e1a8-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:35 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-6bfa4a30-7cfa-416f-aa60-2116a0c7bb4c req-734c0b76-33ac-4098-b193-8332e30ec8d0 tempest-AttachVolumeNegativeTest-2049608112 None] Terminate volume connection completed successfully. Sep 17 15:02:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-6bfa4a30-7cfa-416f-aa60-2116a0c7bb4c req-734c0b76-33ac-4098-b193-8332e30ec8d0 tempest-AttachVolumeNegativeTest-2049608112 None] Deleting attachment 4b1ad01a-7c5b-4091-9d11-78c14d8a734d. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:02:39 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=58,cinder:SELECT=37,cinder:INSERT=13,cinder:DELETE=5 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:02:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:02:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:40 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:02:40 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:40 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.562s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:02:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:02:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:02:40 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Flow 'volume_create_manager' (50f172c0-2725-405b-ae3a-16060c369af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ad7f0f-13a4-401c-8529-d9b5c4f90344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ad7f0f-13a4-401c-8529-d9b5c4f90344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1650470133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f37613-0f58-47c8-8860-29642647a6b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='583ae5b5ad4c48bb8e22953f1ae082da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:41Z,use_quota=True,user_id='5614881e0a824ef59671fe576d1c2ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c0bb37-42fe-4186-8b10-04f1fd9a01d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c0bb37-42fe-4186-8b10-04f1fd9a01d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23fd3a14-31bc-4b4c-94a1-68aef76b649a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23fd3a14-31bc-4b4c-94a1-68aef76b649a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27f37613-0f58-47c8-8860-29642647a6b1', 'volume_name': 'volume-27f37613-0f58-47c8-8860-29642647a6b1', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde2602d-8e07-4051-859e-95a65d2db775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde2602d-8e07-4051-859e-95a65d2db775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453a1c44-a0b6-4366-8d61-fd399ea715e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:41 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Volume 27f37613-0f58-47c8-8860-29642647a6b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27f37613-0f58-47c8-8860-29642647a6b1', 'volume_size': 1} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1650470133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f37613-0f58-47c8-8860-29642647a6b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='583ae5b5ad4c48bb8e22953f1ae082da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:41Z,use_quota=True,user_id='5614881e0a824ef59671fe576d1c2ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Creating volume 27f37613-0f58-47c8-8860-29642647a6b1 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:41 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:02:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-27f37613-0f58-47c8-8860-29642647a6b1 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:41 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-27f37613-0f58-47c8-8860-29642647a6b1 1073741824 Sep 17 15:02:41 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:42 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-27f37613-0f58-47c8-8860-29642647a6b1 1073741824" returned: 0 in 0.881s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-27f37613-0f58-47c8-8860-29642647a6b1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:42 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-27f37613-0f58-47c8-8860-29642647a6b1 Sep 17 15:02:42 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:42 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-27f37613-0f58-47c8-8860-29642647a6b1" returned: 0 in 0.280s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (453a1c44-a0b6-4366-8d61-fd399ea715e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27f37613-0f58-47c8-8860-29642647a6b1', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d507f6-38de-4f66-a523-73f2d8bedc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:42 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Volume volume-27f37613-0f58-47c8-8860-29642647a6b1 (27f37613-0f58-47c8-8860-29642647a6b1): created successfully Sep 17 15:02:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d507f6-38de-4f66-a523-73f2d8bedc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Flow 'volume_create_manager' (50f172c0-2725-405b-ae3a-16060c369af4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:42 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-be0cfb6c-df06-4b7f-a1f3-faee5055f82d tempest-VolumesGetTest-1482151823 None] Created volume successfully. Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Flow 'volume_create_manager' (5c6f504a-9f48-46d0-a5bf-2598d349a1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c857198f-accf-47c8-9dfe-69bd1140dad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c857198f-accf-47c8-9dfe-69bd1140dad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1778813831',display_name='tempest-VolumesGetTest-Volume-295810362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b21bbb-f400-440c-b914-cd52e844722d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583ae5b5ad4c48bb8e22953f1ae082da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:45Z,use_quota=True,user_id='5614881e0a824ef59671fe576d1c2ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d214cad-1477-456f-8cb4-99be34488c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d214cad-1477-456f-8cb4-99be34488c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d8f3e5-b466-404f-aa7a-d2cac999bf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d8f3e5-b466-404f-aa7a-d2cac999bf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87b21bbb-f400-440c-b914-cd52e844722d', 'volume_name': 'volume-87b21bbb-f400-440c-b914-cd52e844722d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df57bfa1-a420-4050-9811-fffddf8d2b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df57bfa1-a420-4050-9811-fffddf8d2b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be01300f-769c-4b93-9774-acaf8507706f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:44 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Volume 87b21bbb-f400-440c-b914-cd52e844722d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87b21bbb-f400-440c-b914-cd52e844722d', 'volume_size': 1} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1778813831',display_name='tempest-VolumesGetTest-Volume-295810362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87b21bbb-f400-440c-b914-cd52e844722d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583ae5b5ad4c48bb8e22953f1ae082da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:45Z,use_quota=True,user_id='5614881e0a824ef59671fe576d1c2ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Creating volume 87b21bbb-f400-440c-b914-cd52e844722d {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:44 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:02:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87b21bbb-f400-440c-b914-cd52e844722d 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:44 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87b21bbb-f400-440c-b914-cd52e844722d 1073741824 Sep 17 15:02:44 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:45 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87b21bbb-f400-440c-b914-cd52e844722d 1073741824" returned: 0 in 0.751s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87b21bbb-f400-440c-b914-cd52e844722d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:45 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87b21bbb-f400-440c-b914-cd52e844722d Sep 17 15:02:45 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:46 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87b21bbb-f400-440c-b914-cd52e844722d" returned: 0 in 0.445s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be01300f-769c-4b93-9774-acaf8507706f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87b21bbb-f400-440c-b914-cd52e844722d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e0e89a-6037-41e9-b8f4-fa0fe8675a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:46 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Volume volume-87b21bbb-f400-440c-b914-cd52e844722d (87b21bbb-f400-440c-b914-cd52e844722d): created successfully Sep 17 15:02:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e0e89a-6037-41e9-b8f4-fa0fe8675a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Flow 'volume_create_manager' (5c6f504a-9f48-46d0-a5bf-2598d349a1d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-38b6799f-3f35-4c86-a264-0376eb9f5b10 tempest-VolumesGetTest-1482151823 None] Created volume successfully. Sep 17 15:02:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] Acquiring lock "cinder-87b21bbb-f400-440c-b914-cd52e844722d-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] Lock "cinder-87b21bbb-f400-440c-b914-cd52e844722d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] Acquiring lock "cinder-quobyte-87b21bbb-f400-440c-b914-cd52e844722d" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] Lock "cinder-quobyte-87b21bbb-f400-440c-b914-cd52e844722d" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:47 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dfeeab-8881-4eff-a5dd-d9a0d71c3fd4]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87b21bbb-f400-440c-b914-cd52e844722d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:47 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87b21bbb-f400-440c-b914-cd52e844722d Sep 17 15:02:47 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:47 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87b21bbb-f400-440c-b914-cd52e844722d" returned: 0 in 0.504s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87b21bbb-f400-440c-b914-cd52e844722d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:47 devstack sudo[94130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87b21bbb-f400-440c-b914-cd52e844722d Sep 17 15:02:47 devstack sudo[94130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:48 devstack sudo[94130]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87b21bbb-f400-440c-b914-cd52e844722d" returned: 0 in 0.340s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] Lock "cinder-quobyte-87b21bbb-f400-440c-b914-cd52e844722d" released by "delete_volume" :: held 0.924s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:48 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] Created reservations ['8f865748-a497-4903-9096-0eed36acda04', '034a3dba-d645-4ef2-964b-29ca17dd5df0', '27501e6b-802b-407a-89dd-9ccd967b8448', '6a0df4e4-8937-46cd-b10b-c95f91e33687'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:48 devstack sudo[94133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:02:48 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:48 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.342s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:48 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:48 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] Deleted volume successfully. Sep 17 15:02:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-409ef09a-9477-404b-9b00-71e85695e7c6 tempest-VolumesGetTest-1482151823 None] Lock "cinder-87b21bbb-f400-440c-b914-cd52e844722d-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] Acquiring lock "cinder-27f37613-0f58-47c8-8860-29642647a6b1-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] Lock "cinder-27f37613-0f58-47c8-8860-29642647a6b1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] Acquiring lock "cinder-quobyte-27f37613-0f58-47c8-8860-29642647a6b1" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] Lock "cinder-quobyte-27f37613-0f58-47c8-8860-29642647a6b1" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:50 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1adae21-6661-413a-b95f-fdf4c9c3c23f]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-27f37613-0f58-47c8-8860-29642647a6b1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:50 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-27f37613-0f58-47c8-8860-29642647a6b1 Sep 17 15:02:50 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-27f37613-0f58-47c8-8860-29642647a6b1" returned: 0 in 0.795s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-27f37613-0f58-47c8-8860-29642647a6b1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:50 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:50 devstack sudo[94149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-27f37613-0f58-47c8-8860-29642647a6b1 Sep 17 15:02:50 devstack sudo[94149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:51 devstack sudo[94149]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-27f37613-0f58-47c8-8860-29642647a6b1" returned: 0 in 0.491s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] Lock "cinder-quobyte-27f37613-0f58-47c8-8860-29642647a6b1" released by "delete_volume" :: held 1.371s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:51 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] Created reservations ['b7015e51-ec45-435f-91f0-d6508dbfbff0', '3449b791-220d-40b1-8317-112fef504071', '2816793c-4f05-4bad-a039-5b63d6c1f959', '57fce8a8-49fb-45f5-ab69-def3485509af'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:51 devstack sudo[94152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:02:51 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:51 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.390s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:51 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] Deleted volume successfully. Sep 17 15:02:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb4ed840-fe6b-4598-b8bd-a8dbae9963be tempest-VolumesGetTest-1482151823 None] Lock "cinder-27f37613-0f58-47c8-8860-29642647a6b1-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Flow 'volume_create_manager' (7c03a70b-4dfd-4ab4-922f-2850f9d945f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28780732-1b50-4061-8148-da1a4dd2477b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28780732-1b50-4061-8148-da1a4dd2477b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1862377150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe55f784-12ac-440b-9e93-b251e1d69b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583ae5b5ad4c48bb8e22953f1ae082da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:53Z,use_quota=True,user_id='5614881e0a824ef59671fe576d1c2ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347c76b9-26c0-4266-a0b5-d92d7222c0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347c76b9-26c0-4266-a0b5-d92d7222c0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f217c40-3515-4c3e-9529-831d012a9b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f217c40-3515-4c3e-9529-831d012a9b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe55f784-12ac-440b-9e93-b251e1d69b69', 'volume_name': 'volume-fe55f784-12ac-440b-9e93-b251e1d69b69', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc2b6db-0384-47ba-82fa-f23d29bcb374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc2b6db-0384-47ba-82fa-f23d29bcb374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d51447-3685-4e27-b4d2-c9f9c65ec706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:52 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Volume fe55f784-12ac-440b-9e93-b251e1d69b69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe55f784-12ac-440b-9e93-b251e1d69b69', 'volume_size': 1} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1862377150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe55f784-12ac-440b-9e93-b251e1d69b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583ae5b5ad4c48bb8e22953f1ae082da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:53Z,use_quota=True,user_id='5614881e0a824ef59671fe576d1c2ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Creating volume fe55f784-12ac-440b-9e93-b251e1d69b69 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:52 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:02:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:52 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 1073741824 Sep 17 15:02:52 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:53 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 1073741824" returned: 0 in 0.564s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:53 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 Sep 17 15:02:53 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Flow 'volume_create_manager' (9bd7b664-79fb-4201-bb4c-512fc1ae9b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c3ca0f6-500e-45a6-aa19-5125619e425b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c3ca0f6-500e-45a6-aa19-5125619e425b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-979858828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165cfa55-f087-4e08-84c8-c8bf6fa19f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb474b692cb54a61a771d2f339ed287a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:54Z,use_quota=True,user_id='17af1c93a68948fa8915e1287a9e1a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503f3871-baa2-4ece-832f-7ccad3bed0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503f3871-baa2-4ece-832f-7ccad3bed0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a019ad-6be2-41df-b7df-82b37ae2e20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a019ad-6be2-41df-b7df-82b37ae2e20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '165cfa55-f087-4e08-84c8-c8bf6fa19f3e', 'volume_name': 'volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d5fd58-cd83-4ab2-8cf6-f6633d412c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d5fd58-cd83-4ab2-8cf6-f6633d412c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd21e5e6-4032-451d-9e02-2061d250da5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:53 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Volume 165cfa55-f087-4e08-84c8-c8bf6fa19f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e', 'volume_size': 1} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:53 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69" returned: 0 in 0.308s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.056s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-979858828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165cfa55-f087-4e08-84c8-c8bf6fa19f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb474b692cb54a61a771d2f339ed287a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:54Z,use_quota=True,user_id='17af1c93a68948fa8915e1287a9e1a6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Creating volume 165cfa55-f087-4e08-84c8-c8bf6fa19f3e {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:53 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d51447-3685-4e27-b4d2-c9f9c65ec706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe55f784-12ac-440b-9e93-b251e1d69b69', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:53 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e 1073741824 Sep 17 15:02:53 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088e397f-9636-4774-84e1-2889d07477ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:53 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Volume volume-fe55f784-12ac-440b-9e93-b251e1d69b69 (fe55f784-12ac-440b-9e93-b251e1d69b69): created successfully Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088e397f-9636-4774-84e1-2889d07477ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Flow 'volume_create_manager' (7c03a70b-4dfd-4ab4-922f-2850f9d945f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-aa8ad404-4dba-42c6-8afd-77c8c88672aa tempest-VolumesGetTest-1482151823 None] Created volume successfully. Sep 17 15:02:54 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e 1073741824" returned: 0 in 0.593s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:54 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e Sep 17 15:02:54 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:54 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e" returned: 0 in 0.299s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd21e5e6-4032-451d-9e02-2061d250da5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735efa03-8b23-49bb-88d6-b0d856cd0cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:54 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Volume volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e (165cfa55-f087-4e08-84c8-c8bf6fa19f3e): created successfully Sep 17 15:02:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735efa03-8b23-49bb-88d6-b0d856cd0cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Flow 'volume_create_manager' (9bd7b664-79fb-4201-bb4c-512fc1ae9b12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:54 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-88801e96-6145-44c2-8651-e860fe45fe41 tempest-VolumesActionsTest-1341087722 None] Created volume successfully. Sep 17 15:02:55 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Flow 'volume_create_manager' (54df6275-69c3-41a4-8bf8-ed480c8b5935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092a14fb-0e2e-47df-adb7-75e6472747ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092a14fb-0e2e-47df-adb7-75e6472747ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-196125618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af3f4776-dc8c-4d94-888e-d27021ea1e3a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='583ae5b5ad4c48bb8e22953f1ae082da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=fe55f784-12ac-440b-9e93-b251e1d69b69,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:55Z,use_quota=True,user_id='5614881e0a824ef59671fe576d1c2ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7055c9c1-5ed0-4393-a7a5-90371adfa031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7055c9c1-5ed0-4393-a7a5-90371adfa031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96832268-40b1-4c09-8fc0-bfc93e353f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96832268-40b1-4c09-8fc0-bfc93e353f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'af3f4776-dc8c-4d94-888e-d27021ea1e3a', 'volume_name': 'volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a', 'volume_size': 1, 'source_volid': 'fe55f784-12ac-440b-9e93-b251e1d69b69', 'source_volstatus': 'available'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9d1877-1c46-4b09-80f1-f638610ad1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9d1877-1c46-4b09-80f1-f638610ad1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047c1c39-e32f-405d-833f-0da435d33c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:55 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Volume af3f4776-dc8c-4d94-888e-d27021ea1e3a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a', 'volume_size': 1, 'source_volid': 'fe55f784-12ac-440b-9e93-b251e1d69b69', 'source_volstatus': 'available'} Sep 17 15:02:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:55 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Cloning volume fe55f784-12ac-440b-9e93-b251e1d69b69 to volume af3f4776-dc8c-4d94-888e-d27021ea1e3a Sep 17 15:02:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Creating offline snapshot 7cb59fed-ef88-4286-8387-946f6c07e686 of volume fe55f784-12ac-440b-9e93-b251e1d69b69 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:02:55 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecab01e-fa92-4815-b23d-d00fddcadd66]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:55 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 Sep 17 15:02:55 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:55 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69" returned: 0 in 0.445s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:56 devstack sudo[94196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686 1G Sep 17 15:02:56 devstack sudo[94196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686 1G" returned: 0 in 0.522s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe55f784-12ac-440b-9e93-b251e1d69b69 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:56 devstack sudo[94196]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:56 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe55f784-12ac-440b-9e93-b251e1d69b69 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686 Sep 17 15:02:56 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:57 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe55f784-12ac-440b-9e93-b251e1d69b69 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686" returned: 0 in 0.640s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:57 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686 is being set with open permissions: ugo+rw Sep 17 15:02:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:57 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686 Sep 17 15:02:57 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:57 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686" returned: 0 in 0.550s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:57 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.info Sep 17 15:02:57 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:58 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.info" returned: 0 in 0.495s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:58 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.info is being set with open permissions: ugo+rw Sep 17 15:02:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:58 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.info Sep 17 15:02:58 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:58 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.info" returned: 0 in 0.502s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Acquiring lock "cinder-quobyte-af3f4776-dc8c-4d94-888e-d27021ea1e3a" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Lock "cinder-quobyte-af3f4776-dc8c-4d94-888e-d27021ea1e3a" acquired by "_copy_volume_from_snapshot" :: waited 0.051s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] snapshot: 7cb59fed-ef88-4286-8387-946f6c07e686, volume: af3f4776-dc8c-4d94-888e-d27021ea1e3a, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:02:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:58 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1efbd2-47cc-4053-84a3-24646dfb2628]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:59 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686 Sep 17 15:02:59 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:59 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686" returned: 0 in 0.885s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe55f784-12ac-440b-9e93-b251e1d69b69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:02:59 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac8f32e-6690-490d-8b25-f9c4f40c3bdc]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:00 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 Sep 17 15:03:00 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:00 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69" returned: 0 in 0.653s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:03:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:03:00 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Path /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:03:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:00 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a Sep 17 15:03:00 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:07 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=55,cinder:UPDATE=69,cinder:DELETE=8,cinder:INSERT=16 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:03:07 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=21,cinder:UPDATE=33,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:03:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] Acquiring lock "cinder-5373ff8d-9374-4f47-b063-2ac7890e5645-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] Lock "cinder-5373ff8d-9374-4f47-b063-2ac7890e5645-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] Acquiring lock "cinder-quobyte-5373ff8d-9374-4f47-b063-2ac7890e5645" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] Lock "cinder-quobyte-5373ff8d-9374-4f47-b063-2ac7890e5645" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:13 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa260090-3303-4b79-94b3-7fce2c59a7ac]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5373ff8d-9374-4f47-b063-2ac7890e5645 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:13 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a" returned: 0 in 13.068s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:13 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Image conversion details: src /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69, size 1024.00 MB, duration 13.07 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:03:13 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Converted 1024.00 MB image at 78.35 MB/s Sep 17 15:03:13 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a is being set with open permissions: ugo+rw Sep 17 15:03:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:13 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a Sep 17 15:03:13 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:13 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5373ff8d-9374-4f47-b063-2ac7890e5645 Sep 17 15:03:13 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:13 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a" returned: 0 in 0.341s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4696d578-3171-4659-96ac-e869be1925af tempest-VolumesActionsTest-1341087722 None] Acquiring lock "cinder-165cfa55-f087-4e08-84c8-c8bf6fa19f3e" by "attach_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Lock "cinder-quobyte-af3f4776-dc8c-4d94-888e-d27021ea1e3a" released by "_copy_volume_from_snapshot" :: held 15.150s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4696d578-3171-4659-96ac-e869be1925af tempest-VolumesActionsTest-1341087722 None] Lock "cinder-165cfa55-f087-4e08-84c8-c8bf6fa19f3e" acquired by "attach_volume" :: waited 0.029s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Acquiring lock "cinder-quobyte-7cb59fed-ef88-4286-8387-946f6c07e686" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Lock "cinder-quobyte-7cb59fed-ef88-4286-8387-946f6c07e686" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Deleting offline snapshot 7cb59fed-ef88-4286-8387-946f6c07e686 of volume fe55f784-12ac-440b-9e93-b251e1d69b69 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] snapshot_file for this snap is: volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fc689a-40ff-438f-9f0f-e34d71cf7691]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4696d578-3171-4659-96ac-e869be1925af tempest-VolumesActionsTest-1341087722 None] Attaching volume 165cfa55-f087-4e08-84c8-c8bf6fa19f3e to instance ccd659d4-1e18-4fe3-9c4e-a45e933d08bf at mountpoint /dev/vdb on host None. Sep 17 15:03:14 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5373ff8d-9374-4f47-b063-2ac7890e5645" returned: 0 in 0.554s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5373ff8d-9374-4f47-b063-2ac7890e5645 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4696d578-3171-4659-96ac-e869be1925af tempest-VolumesActionsTest-1341087722 None] Attach volume completed successfully. Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4696d578-3171-4659-96ac-e869be1925af tempest-VolumesActionsTest-1341087722 None] Lock "cinder-165cfa55-f087-4e08-84c8-c8bf6fa19f3e" released by "attach_volume" :: held 0.185s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:14 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5373ff8d-9374-4f47-b063-2ac7890e5645 Sep 17 15:03:14 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:14 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686 Sep 17 15:03:14 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-75f4b135-6a7a-42f0-892d-86718a472191 tempest-VolumesActionsTest-1341087722 None] Acquiring lock "cinder-165cfa55-f087-4e08-84c8-c8bf6fa19f3e-detach_volume" by "detach_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-75f4b135-6a7a-42f0-892d-86718a472191 tempest-VolumesActionsTest-1341087722 None] Lock "cinder-165cfa55-f087-4e08-84c8-c8bf6fa19f3e-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-75f4b135-6a7a-42f0-892d-86718a472191 tempest-VolumesActionsTest-1341087722 None] Detaching volume 165cfa55-f087-4e08-84c8-c8bf6fa19f3e from instance ccd659d4-1e18-4fe3-9c4e-a45e933d08bf. Sep 17 15:03:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-75f4b135-6a7a-42f0-892d-86718a472191 tempest-VolumesActionsTest-1341087722 None] Detach volume completed successfully. Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-75f4b135-6a7a-42f0-892d-86718a472191 tempest-VolumesActionsTest-1341087722 None] Lock "cinder-165cfa55-f087-4e08-84c8-c8bf6fa19f3e-detach_volume" released by "detach_volume" :: held 0.115s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:14 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5373ff8d-9374-4f47-b063-2ac7890e5645" returned: 0 in 0.376s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] Lock "cinder-quobyte-5373ff8d-9374-4f47-b063-2ac7890e5645" released by "delete_volume" :: held 1.017s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:14 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686" returned: 0 in 0.542s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe55f784-12ac-440b-9e93-b251e1d69b69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] Created reservations ['ec228757-43fc-45b7-a2de-099ae01d20e3', 'c9d785cd-ee67-4df9-bafe-1c4e4e17cf09', '80ad86cb-0626-4ef2-8b2c-796a9710b2e5', '335dd101-3abe-4c58-b7ee-8ee083c17eff'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[66106708-6ded-4acb-bda2-67283e40f760]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:14 devstack sudo[94508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 Sep 17 15:03:14 devstack sudo[94508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:14 devstack sudo[94509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:03:14 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:15 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.354s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:15 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:03:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] Deleted volume successfully. Sep 17 15:03:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4643944b-d34c-4b3e-8c8e-6dfb738b3606 tempest-AttachVolumeShelveTestJSON-1164365962 None] Lock "cinder-5373ff8d-9374-4f47-b063-2ac7890e5645-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:15 devstack sudo[94508]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69" returned: 0 in 0.714s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:15 devstack sudo[94534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686 Sep 17 15:03:15 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:15 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686" returned: 0 in 0.395s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:15 devstack sudo[94545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686 Sep 17 15:03:15 devstack sudo[94545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:16 devstack sudo[94545]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69.7cb59fed-ef88-4286-8387-946f6c07e686" returned: 0 in 0.302s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Lock "cinder-quobyte-7cb59fed-ef88-4286-8387-946f6c07e686" released by "_delete_snapshot" :: held 2.124s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.768s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047c1c39-e32f-405d-833f-0da435d33c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a', 'volume_size': 1, 'source_volid': 'fe55f784-12ac-440b-9e93-b251e1d69b69', 'source_volstatus': 'available'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc171c9-b8e2-4c18-be88-f51f13e4c6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:16 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Volume volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a (af3f4776-dc8c-4d94-888e-d27021ea1e3a): created successfully Sep 17 15:03:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc171c9-b8e2-4c18-be88-f51f13e4c6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Flow 'volume_create_manager' (54df6275-69c3-41a4-8bf8-ed480c8b5935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:16 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0640f9b4-afdb-4de8-ac40-d1f2a6ccff6d tempest-VolumesGetTest-1482151823 None] Created volume successfully. Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Flow 'volume_create_manager' (72f18628-6672-4622-ae08-eae294aa7bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f752acbb-a9ed-4ee6-b878-56567f8b1d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f752acbb-a9ed-4ee6-b878-56567f8b1d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1350571157',display_name='tempest-VolumesGetTest-Volume-874737733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f240145-4804-41a5-8c78-2f045cd73a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583ae5b5ad4c48bb8e22953f1ae082da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:18Z,use_quota=True,user_id='5614881e0a824ef59671fe576d1c2ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c33761a0-cc2c-4eb9-8e16-6d4d115c2085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c33761a0-cc2c-4eb9-8e16-6d4d115c2085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b399f8e-808f-4c3e-b195-e127d0bd7e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b399f8e-808f-4c3e-b195-e127d0bd7e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f240145-4804-41a5-8c78-2f045cd73a82', 'volume_name': 'volume-6f240145-4804-41a5-8c78-2f045cd73a82', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6f19e1-9dda-4be7-a71f-d17b26156f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a6f19e1-9dda-4be7-a71f-d17b26156f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4dbe811-02be-4cf6-9efd-cf1e2d3b7fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:18 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Volume 6f240145-4804-41a5-8c78-2f045cd73a82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f240145-4804-41a5-8c78-2f045cd73a82', 'volume_size': 1} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1350571157',display_name='tempest-VolumesGetTest-Volume-874737733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f240145-4804-41a5-8c78-2f045cd73a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583ae5b5ad4c48bb8e22953f1ae082da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:18Z,use_quota=True,user_id='5614881e0a824ef59671fe576d1c2ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Creating volume 6f240145-4804-41a5-8c78-2f045cd73a82 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:03:18 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6f240145-4804-41a5-8c78-2f045cd73a82 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:18 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6f240145-4804-41a5-8c78-2f045cd73a82 1073741824 Sep 17 15:03:18 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:18 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6f240145-4804-41a5-8c78-2f045cd73a82 1073741824" returned: 0 in 0.636s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6f240145-4804-41a5-8c78-2f045cd73a82 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:18 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6f240145-4804-41a5-8c78-2f045cd73a82 Sep 17 15:03:18 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:19 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6f240145-4804-41a5-8c78-2f045cd73a82" returned: 0 in 0.300s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:03:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4dbe811-02be-4cf6-9efd-cf1e2d3b7fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f240145-4804-41a5-8c78-2f045cd73a82', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c8e2d6-8b1d-4278-8baa-cda4cbed8739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:19 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Volume volume-6f240145-4804-41a5-8c78-2f045cd73a82 (6f240145-4804-41a5-8c78-2f045cd73a82): created successfully Sep 17 15:03:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8c8e2d6-8b1d-4278-8baa-cda4cbed8739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Flow 'volume_create_manager' (72f18628-6672-4622-ae08-eae294aa7bef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:19 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7f0f7117-a54e-4d79-ab3a-4dab201da467 tempest-VolumesGetTest-1482151823 None] Created volume successfully. Sep 17 15:03:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] Acquiring lock "cinder-6f240145-4804-41a5-8c78-2f045cd73a82-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] Lock "cinder-6f240145-4804-41a5-8c78-2f045cd73a82-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] Acquiring lock "cinder-quobyte-6f240145-4804-41a5-8c78-2f045cd73a82" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] Lock "cinder-quobyte-6f240145-4804-41a5-8c78-2f045cd73a82" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:20 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f84b8bb-14b7-4796-87d3-b06e0fc0190c]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6f240145-4804-41a5-8c78-2f045cd73a82 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:21 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6f240145-4804-41a5-8c78-2f045cd73a82 Sep 17 15:03:21 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:21 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6f240145-4804-41a5-8c78-2f045cd73a82" returned: 0 in 0.652s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6f240145-4804-41a5-8c78-2f045cd73a82 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:21 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6f240145-4804-41a5-8c78-2f045cd73a82 Sep 17 15:03:21 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:21 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6f240145-4804-41a5-8c78-2f045cd73a82" returned: 0 in 0.303s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] Lock "cinder-quobyte-6f240145-4804-41a5-8c78-2f045cd73a82" released by "delete_volume" :: held 1.029s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:21 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] Created reservations ['c5c6dbe2-7270-4a7f-bfa1-b9f95125ad3f', 'eeafc390-b182-49f4-b33c-53149233c5e2', '422ee0bd-750d-4bdb-9a81-67aa597927db', '6bd281e0-16a5-4c0c-8e6e-9bd826eab0bf'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:03:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:21 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:03:21 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:22 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.269s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:22 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:03:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] Deleted volume successfully. Sep 17 15:03:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-488767c1-5cd7-4a9d-ab3d-05b4fd88f4d5 tempest-VolumesGetTest-1482151823 None] Lock "cinder-6f240145-4804-41a5-8c78-2f045cd73a82-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] Acquiring lock "cinder-af3f4776-dc8c-4d94-888e-d27021ea1e3a-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] Lock "cinder-af3f4776-dc8c-4d94-888e-d27021ea1e3a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] Acquiring lock "cinder-quobyte-af3f4776-dc8c-4d94-888e-d27021ea1e3a" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] Lock "cinder-quobyte-af3f4776-dc8c-4d94-888e-d27021ea1e3a" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:23 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3aac97-e70c-47f4-ab42-fd97d6341b2e]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:23 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a Sep 17 15:03:23 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:23 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a" returned: 0 in 0.769s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:23 devstack sudo[94655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a Sep 17 15:03:23 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:24 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-af3f4776-dc8c-4d94-888e-d27021ea1e3a" returned: 0 in 0.647s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] Lock "cinder-quobyte-af3f4776-dc8c-4d94-888e-d27021ea1e3a" released by "delete_volume" :: held 1.503s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:24 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] Created reservations ['b801f9f9-300e-42e6-9817-f1df1fa6c564', '86fe3bb8-1fe4-4191-8d78-e71ed30ac5c5', '520d333f-e404-4654-838a-9816a3f56dea', 'fff33744-e95b-4c1c-8e29-57db726757a1'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:03:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:24 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:03:24 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:25 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.372s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:03:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] Deleted volume successfully. Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e87439e7-d50d-4de7-ad49-1c9754e4f947 tempest-VolumesGetTest-1482151823 None] Lock "cinder-af3f4776-dc8c-4d94-888e-d27021ea1e3a-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] Acquiring lock "cinder-fe55f784-12ac-440b-9e93-b251e1d69b69-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] Lock "cinder-fe55f784-12ac-440b-9e93-b251e1d69b69-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Flow 'volume_create_manager' (499bb094-d35c-49bf-bb90-bca602612368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa8a732-0358-4dd4-b746-756f8f137a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] Acquiring lock "cinder-quobyte-fe55f784-12ac-440b-9e93-b251e1d69b69" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa8a732-0358-4dd4-b746-756f8f137a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1630770971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c05334-66ea-4fd3-9135-e281e2868d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffb7cf2144c94d5fbc0925564117ed45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:26Z,use_quota=True,user_id='8d3785d8f6ad468f94195c9a8e6c8063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd53e455-8b91-4f6f-89f1-bef7cf64cb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd53e455-8b91-4f6f-89f1-bef7cf64cb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc10360-2f19-47e2-a658-7946fc905f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc10360-2f19-47e2-a658-7946fc905f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76c05334-66ea-4fd3-9135-e281e2868d64', 'volume_name': 'volume-76c05334-66ea-4fd3-9135-e281e2868d64', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75e641a-88fc-42cf-83b8-5c8a47c7cf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75e641a-88fc-42cf-83b8-5c8a47c7cf29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b2dbc0-a100-4386-8632-6c51ca5a4b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:25 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Volume 76c05334-66ea-4fd3-9135-e281e2868d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76c05334-66ea-4fd3-9135-e281e2868d64', 'volume_size': 1} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1630770971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c05334-66ea-4fd3-9135-e281e2868d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffb7cf2144c94d5fbc0925564117ed45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:26Z,use_quota=True,user_id='8d3785d8f6ad468f94195c9a8e6c8063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Creating volume 76c05334-66ea-4fd3-9135-e281e2868d64 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:03:25 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:03:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76c05334-66ea-4fd3-9135-e281e2868d64 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] Lock "cinder-quobyte-fe55f784-12ac-440b-9e93-b251e1d69b69" acquired by "delete_volume" :: waited 0.111s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:26 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76c05334-66ea-4fd3-9135-e281e2868d64 1073741824 Sep 17 15:03:26 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:26 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f6bcf1-cdff-4aa7-bc33-d642188ec85b]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1fc973fb-ed41-44a8-be22-37e110c434e5 tempest-VolumesActionsTest-1341087722 None] Acquiring lock "cinder-165cfa55-f087-4e08-84c8-c8bf6fa19f3e" by "attach_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:26 devstack sudo[94678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 Sep 17 15:03:26 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1fc973fb-ed41-44a8-be22-37e110c434e5 tempest-VolumesActionsTest-1341087722 None] Lock "cinder-165cfa55-f087-4e08-84c8-c8bf6fa19f3e" acquired by "attach_volume" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1fc973fb-ed41-44a8-be22-37e110c434e5 tempest-VolumesActionsTest-1341087722 None] Attaching volume 165cfa55-f087-4e08-84c8-c8bf6fa19f3e to instance 40cdda9f-164b-4044-a8e7-3e80144e35b7 at mountpoint /dev/vdb on host None. Sep 17 15:03:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1fc973fb-ed41-44a8-be22-37e110c434e5 tempest-VolumesActionsTest-1341087722 None] Attach volume completed successfully. Sep 17 15:03:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1fc973fb-ed41-44a8-be22-37e110c434e5 tempest-VolumesActionsTest-1341087722 None] Lock "cinder-165cfa55-f087-4e08-84c8-c8bf6fa19f3e" released by "attach_volume" :: held 0.214s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:26 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69" returned: 0 in 0.562s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:26 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76c05334-66ea-4fd3-9135-e281e2868d64 1073741824" returned: 0 in 0.747s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:26 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69 Sep 17 15:03:26 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76c05334-66ea-4fd3-9135-e281e2868d64 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:26 devstack sudo[94690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76c05334-66ea-4fd3-9135-e281e2868d64 Sep 17 15:03:26 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:27 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fe55f784-12ac-440b-9e93-b251e1d69b69" returned: 0 in 0.550s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] Lock "cinder-quobyte-fe55f784-12ac-440b-9e93-b251e1d69b69" released by "delete_volume" :: held 1.270s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:27 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76c05334-66ea-4fd3-9135-e281e2868d64" returned: 0 in 0.490s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b2dbc0-a100-4386-8632-6c51ca5a4b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c05334-66ea-4fd3-9135-e281e2868d64', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9e3c74-6fe1-4003-ac70-c84399d3e6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c62d8f98-8762-4af4-90fc-0db2e9043495 tempest-VolumesActionsTest-1341087722 None] Acquiring lock "cinder-165cfa55-f087-4e08-84c8-c8bf6fa19f3e-detach_volume" by "detach_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] Created reservations ['576182d7-9625-4ac6-a318-289fb400b8e9', 'c980e84e-b477-4ebd-b3f4-21089d95c618', '62162a3b-bc8a-48b4-a3db-ab5929a65c84', '37a55850-2715-4912-b0ce-d48cb4d6ef48'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:03:27 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Volume volume-76c05334-66ea-4fd3-9135-e281e2868d64 (76c05334-66ea-4fd3-9135-e281e2868d64): created successfully Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9e3c74-6fe1-4003-ac70-c84399d3e6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Flow 'volume_create_manager' (499bb094-d35c-49bf-bb90-bca602612368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c62d8f98-8762-4af4-90fc-0db2e9043495 tempest-VolumesActionsTest-1341087722 None] Lock "cinder-165cfa55-f087-4e08-84c8-c8bf6fa19f3e-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c62d8f98-8762-4af4-90fc-0db2e9043495 tempest-VolumesActionsTest-1341087722 None] Detaching volume 165cfa55-f087-4e08-84c8-c8bf6fa19f3e from instance 40cdda9f-164b-4044-a8e7-3e80144e35b7. Sep 17 15:03:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-853eb856-3bdc-4558-9e7f-c3fce82cdb03 tempest-AttachVolumeNegativeTest-2049608112 None] Created volume successfully. Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c62d8f98-8762-4af4-90fc-0db2e9043495 tempest-VolumesActionsTest-1341087722 None] Detach volume completed successfully. Sep 17 15:03:27 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:03:27 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c62d8f98-8762-4af4-90fc-0db2e9043495 tempest-VolumesActionsTest-1341087722 None] Lock "cinder-165cfa55-f087-4e08-84c8-c8bf6fa19f3e-detach_volume" released by "detach_volume" :: held 0.220s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:28 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.593s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:28 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:03:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] Deleted volume successfully. Sep 17 15:03:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6b2bda78-1005-418b-850f-4d03c41bf0d1 tempest-VolumesGetTest-1482151823 None] Lock "cinder-fe55f784-12ac-440b-9e93-b251e1d69b69-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-a3e5cc5c-4e8c-4835-81ce-298f6c797649 req-c4862979-417c-4b8a-ba1b-3bf4e488cdb0 tempest-AttachVolumeNegativeTest-2049608112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-a3e5cc5c-4e8c-4835-81ce-298f6c797649 req-c4862979-417c-4b8a-ba1b-3bf4e488cdb0 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-a3e5cc5c-4e8c-4835-81ce-298f6c797649 req-c4862979-417c-4b8a-ba1b-3bf4e488cdb0 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-a3e5cc5c-4e8c-4835-81ce-298f6c797649 req-c4862979-417c-4b8a-ba1b-3bf4e488cdb0 tempest-AttachVolumeNegativeTest-2049608112 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-76c05334-66ea-4fd3-9135-e281e2868d64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5782ef7a-7ad4-419e-9c87-1fef427ff23e', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:03:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-a3e5cc5c-4e8c-4835-81ce-298f6c797649 req-c4862979-417c-4b8a-ba1b-3bf4e488cdb0 tempest-AttachVolumeNegativeTest-2049608112 None] attachment_update completed successfully. Sep 17 15:03:29 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:03:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Flow 'volume_create_manager' (8019a785-1239-43cb-9f24-dfaf1016cb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7980f9f0-d9bc-4d75-810b-697a5654b4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7980f9f0-d9bc-4d75-810b-697a5654b4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2123832593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfded238-bf51-428b-b013-f02e1d16649c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='583ae5b5ad4c48bb8e22953f1ae082da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:29Z,use_quota=True,user_id='5614881e0a824ef59671fe576d1c2ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15049f05-ffa0-424a-b8be-68c13fa62f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15049f05-ffa0-424a-b8be-68c13fa62f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efae6933-4ce2-4ef4-9682-86986c2f0c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:29 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:03:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efae6933-4ce2-4ef4-9682-86986c2f0c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dfded238-bf51-428b-b013-f02e1d16649c', 'volume_name': 'volume-dfded238-bf51-428b-b013-f02e1d16649c', 'volume_size': 1, 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a89aff0fcdbc4ac4a1aadbcc303a1058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd928b357-d516-479a-9030-78a0e857cb53', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d928b357-d516-479a-9030-78a0e857cb53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15283c40-de79-4a03-b323-eec7cbd3d0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15283c40-de79-4a03-b323-eec7cbd3d0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f82989d-71cb-42fb-b665-340f3d1be654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:30 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Volume dfded238-bf51-428b-b013-f02e1d16649c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dfded238-bf51-428b-b013-f02e1d16649c', 'volume_size': 1, 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a89aff0fcdbc4ac4a1aadbcc303a1058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd928b357-d516-479a-9030-78a0e857cb53', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d928b357-d516-479a-9030-78a0e857cb53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 15:03:30 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Trying to clone dfded238-bf51-428b-b013-f02e1d16649c from image d928b357-d516-479a-9030-78a0e857cb53 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:03:30 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_6d_dzh1odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 15:03:30 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Image download 20.69 MB at 20.69 MB/s Sep 17 15:03:31 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[609ebf6b-aa4e-41c0-aa96-d2a5b998e537]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_6d_dzh1odevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:31 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_6d_dzh1odevstack@QuobyteHD Sep 17 15:03:31 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:31 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_6d_dzh1odevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:31 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Temporary image d928b357-d516-479a-9030-78a0e857cb53 is fetched for user 5614881e0a824ef59671fe576d1c2ab0. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 15:03:31 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a45b52-dca0-49dc-8a63-988b811ad26c]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_6d_dzh1odevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:31 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_6d_dzh1odevstack@QuobyteHD Sep 17 15:03:31 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:32 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:32 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-53640864-5fde-4b86-ac8a-9461d456e4c0 req-05ab4129-2e79-406c-a30f-57e6bc75176a tempest-AttachVolumeNegativeTest-2049608112 None] Terminate volume connection completed successfully. Sep 17 15:03:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-53640864-5fde-4b86-ac8a-9461d456e4c0 req-05ab4129-2e79-406c-a30f-57e6bc75176a tempest-AttachVolumeNegativeTest-2049608112 None] Deleting attachment 5782ef7a-7ad4-419e-9c87-1fef427ff23e. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:03:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_6d_dzh1odevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2123832593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfded238-bf51-428b-b013-f02e1d16649c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='583ae5b5ad4c48bb8e22953f1ae082da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:29Z,use_quota=True,user_id='5614881e0a824ef59671fe576d1c2ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:03:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Creating volume dfded238-bf51-428b-b013-f02e1d16649c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:03:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:03:32 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:03:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:32 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c 1073741824 Sep 17 15:03:32 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:32 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c 1073741824" returned: 0 in 0.539s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:32 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c Sep 17 15:03:32 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:33 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c" returned: 0 in 0.354s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:03:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:33 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Attempting download of d928b357-d516-479a-9030-78a0e857cb53 ((None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}])) to volume dfded238-bf51-428b-b013-f02e1d16649c. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:03:33 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cbed54-5f31-4cb5-97b1-e2aca1ab63fe]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_s3nb0mh5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:33 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_s3nb0mh5 Sep 17 15:03:33 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-510a08f2-9d31-4923-9f40-ea5897d18066 tempest-VolumesActionsTest-1341087722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-510a08f2-9d31-4923-9f40-ea5897d18066 tempest-VolumesActionsTest-1341087722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:33 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a5896f-40e4-4155-a4c2-7a2991630c00]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-510a08f2-9d31-4923-9f40-ea5897d18066 tempest-VolumesActionsTest-1341087722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:33 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_s3nb0mh5" returned: 0 in 0.510s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_s3nb0mh5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:33 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e Sep 17 15:03:33 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:33 devstack sudo[95219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_s3nb0mh5 Sep 17 15:03:33 devstack sudo[95219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:34 devstack sudo[95219]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_s3nb0mh5" returned: 1 in 0.410s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_s3nb0mh5' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:03:34 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[50374c9a-df53-40c6-85e1-c80c4033db1e]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_6d_dzh1odevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:34 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-510a08f2-9d31-4923-9f40-ea5897d18066 tempest-VolumesActionsTest-1341087722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e" returned: 0 in 0.539s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:34 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d27dc2e-a4f7-4acf-968b-16de0b4a993b]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-510a08f2-9d31-4923-9f40-ea5897d18066 tempest-VolumesActionsTest-1341087722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:34 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_6d_dzh1odevstack@QuobyteHD Sep 17 15:03:34 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:34 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e Sep 17 15:03:34 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:34 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_6d_dzh1odevstack@QuobyteHD" returned: 0 in 0.542s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:34 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] d928b357-d516-479a-9030-78a0e857cb53 was qcow2, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 15:03:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_6d_dzh1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:34 devstack sudo[95238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_6d_dzh1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c Sep 17 15:03:34 devstack sudo[95238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:34 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-510a08f2-9d31-4923-9f40-ea5897d18066 tempest-VolumesActionsTest-1341087722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e" returned: 0 in 0.577s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-510a08f2-9d31-4923-9f40-ea5897d18066 tempest-VolumesActionsTest-1341087722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.0a5ddafe-5798-4f6f-9d0c-5d5a4323a930cvapvddu.img {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:34 devstack sudo[95241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.0a5ddafe-5798-4f6f-9d0c-5d5a4323a930cvapvddu.img Sep 17 15:03:34 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:03:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:40 devstack sudo[95264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:03:40 devstack sudo[95264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:40 devstack sudo[95238]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_6d_dzh1odevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c" returned: 0 in 6.273s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:40 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_6d_dzh1odevstack@QuobyteHD, size 112.00 MB, duration 6.28 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:03:40 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Converted 112.00 MB image at 17.84 MB/s Sep 17 15:03:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:40 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c 1G Sep 17 15:03:40 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:41 devstack sudo[95264]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.639s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:41 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:03:41 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:03:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:03:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:03:41 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c 1G" returned: 0 in 0.824s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:41 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Downloaded image d928b357-d516-479a-9030-78a0e857cb53 ((None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}])) to volume dfded238-bf51-428b-b013-f02e1d16649c successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:03:41 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Temporary image d928b357-d516-479a-9030-78a0e857cb53 for user 5614881e0a824ef59671fe576d1c2ab0 is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 15:03:41 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Marking volume dfded238-bf51-428b-b013-f02e1d16649c as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:03:41 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Copying metadata from image d928b357-d516-479a-9030-78a0e857cb53 to dfded238-bf51-428b-b013-f02e1d16649c. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:03:41 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Creating volume glance metadata for volume dfded238-bf51-428b-b013-f02e1d16649c backed by image d928b357-d516-479a-9030-78a0e857cb53 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:03:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f82989d-71cb-42fb-b665-340f3d1be654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfded238-bf51-428b-b013-f02e1d16649c', 'volume_size': 1, 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a89aff0fcdbc4ac4a1aadbcc303a1058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd928b357-d516-479a-9030-78a0e857cb53', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d928b357-d516-479a-9030-78a0e857cb53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523cfeec-11fd-4a96-8428-5a5879fb490a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:42 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Volume volume-dfded238-bf51-428b-b013-f02e1d16649c (dfded238-bf51-428b-b013-f02e1d16649c): created successfully Sep 17 15:03:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523cfeec-11fd-4a96-8428-5a5879fb490a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Flow 'volume_create_manager' (8019a785-1239-43cb-9f24-dfaf1016cb8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:42 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a87994c1-e913-4def-b4c3-c1a76bdbf3fb tempest-VolumesGetTest-1482151823 None] Created volume successfully. Sep 17 15:03:44 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-510a08f2-9d31-4923-9f40-ea5897d18066 tempest-VolumesActionsTest-1341087722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.0a5ddafe-5798-4f6f-9d0c-5d5a4323a930cvapvddu.img" returned: 0 in 9.587s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:44 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4de9b0-fd06-4fb5-a190-b2ad93b7e57b]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-510a08f2-9d31-4923-9f40-ea5897d18066 tempest-VolumesActionsTest-1341087722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:44 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e Sep 17 15:03:44 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:44 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:03:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Flow 'volume_create_manager' (1784ac3a-160b-4448-a90d-2b7a976f7011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c11234-e26e-49cf-8525-3f3e56485b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c11234-e26e-49cf-8525-3f3e56485b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-609855554',display_name='tempest-VolumesGetTest-Volume-53017454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dc46d0-c92f-406c-a3e7-33f7dbcdd021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583ae5b5ad4c48bb8e22953f1ae082da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:44Z,use_quota=True,user_id='5614881e0a824ef59671fe576d1c2ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd20443-12d4-4e36-9dba-8b4030798964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd20443-12d4-4e36-9dba-8b4030798964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd1e29c-7de3-45b0-8f13-664dbc4c4bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd1e29c-7de3-45b0-8f13-664dbc4c4bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95dc46d0-c92f-406c-a3e7-33f7dbcdd021', 'volume_name': 'volume-95dc46d0-c92f-406c-a3e7-33f7dbcdd021', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608ea73e-f821-42f9-aaee-7e252608e61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608ea73e-f821-42f9-aaee-7e252608e61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127d097d-84f5-4bad-8705-a3094001f307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:44 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Volume 95dc46d0-c92f-406c-a3e7-33f7dbcdd021: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95dc46d0-c92f-406c-a3e7-33f7dbcdd021', 'volume_size': 1} Sep 17 15:03:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:44 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-510a08f2-9d31-4923-9f40-ea5897d18066 tempest-VolumesActionsTest-1341087722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e" returned: 0 in 0.661s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:44 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-510a08f2-9d31-4923-9f40-ea5897d18066 tempest-VolumesActionsTest-1341087722 None] Image conversion details: src /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e, size 1024.00 MB, duration 9.59 sec, destination /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.0a5ddafe-5798-4f6f-9d0c-5d5a4323a930cvapvddu.img {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:03:44 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-510a08f2-9d31-4923-9f40-ea5897d18066 tempest-VolumesActionsTest-1341087722 None] Converted 1024.00 MB image at 106.80 MB/s Sep 17 15:03:44 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-510a08f2-9d31-4923-9f40-ea5897d18066 tempest-VolumesActionsTest-1341087722 None] 0a5ddafe-5798-4f6f-9d0c-5d5a4323a930 was raw, no need to convert to raw {{(pid=86082) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 17 15:03:56 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=62,cinder:UPDATE=54,cinder:INSERT=17,cinder:DELETE=3 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:03:56 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=55,cinder:SELECT=54,cinder:INSERT=20,cinder:DELETE=5 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:04:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-510a08f2-9d31-4923-9f40-ea5897d18066 tempest-VolumesActionsTest-1341087722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 40.380s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-510a08f2-9d31-4923-9f40-ea5897d18066 tempest-VolumesActionsTest-1341087722 None] Uploaded volume to glance image-id: 0a5ddafe-5798-4f6f-9d0c-5d5a4323a930. {{(pid=86082) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 17 15:04:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.299s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-609855554',display_name='tempest-VolumesGetTest-Volume-53017454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95dc46d0-c92f-406c-a3e7-33f7dbcdd021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583ae5b5ad4c48bb8e22953f1ae082da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:44Z,use_quota=True,user_id='5614881e0a824ef59671fe576d1c2ab0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:04:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Creating volume 95dc46d0-c92f-406c-a3e7-33f7dbcdd021 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:04:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:04:13 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:04:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-95dc46d0-c92f-406c-a3e7-33f7dbcdd021 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:13 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-95dc46d0-c92f-406c-a3e7-33f7dbcdd021 1073741824 Sep 17 15:04:13 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:13 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-510a08f2-9d31-4923-9f40-ea5897d18066 tempest-VolumesActionsTest-1341087722 None] Copy volume to image completed successfully. Sep 17 15:04:14 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-95dc46d0-c92f-406c-a3e7-33f7dbcdd021 1073741824" returned: 0 in 0.467s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-95dc46d0-c92f-406c-a3e7-33f7dbcdd021 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:14 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-95dc46d0-c92f-406c-a3e7-33f7dbcdd021 Sep 17 15:04:14 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:14 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-95dc46d0-c92f-406c-a3e7-33f7dbcdd021" returned: 0 in 0.272s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:04:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (127d097d-84f5-4bad-8705-a3094001f307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95dc46d0-c92f-406c-a3e7-33f7dbcdd021', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39823e35-0503-465e-9e91-96bd2085a777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:14 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Volume volume-95dc46d0-c92f-406c-a3e7-33f7dbcdd021 (95dc46d0-c92f-406c-a3e7-33f7dbcdd021): created successfully Sep 17 15:04:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39823e35-0503-465e-9e91-96bd2085a777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Flow 'volume_create_manager' (1784ac3a-160b-4448-a90d-2b7a976f7011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e291f14f-4992-45ec-b81a-bd28019f16b4 tempest-VolumesGetTest-1482151823 None] Created volume successfully. Sep 17 15:04:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:15 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6688e73b-a802-4da6-9df5-9befe542fcaf]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:15 devstack sudo[95600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e Sep 17 15:04:15 devstack sudo[95600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:15 devstack sudo[95600]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e" returned: 0 in 0.374s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:15 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3180725b-c8ed-4746-8e43-1b8ede147a0d]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:15 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e Sep 17 15:04:15 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:15 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e" returned: 0 in 0.354s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.8fdc61d3-996c-4b1d-a583-960a65660000k51t9cwt.img {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:15 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.8fdc61d3-996c-4b1d-a583-960a65660000k51t9cwt.img Sep 17 15:04:15 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] Acquiring lock "cinder-95dc46d0-c92f-406c-a3e7-33f7dbcdd021-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] Lock "cinder-95dc46d0-c92f-406c-a3e7-33f7dbcdd021-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] Acquiring lock "cinder-quobyte-95dc46d0-c92f-406c-a3e7-33f7dbcdd021" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] Lock "cinder-quobyte-95dc46d0-c92f-406c-a3e7-33f7dbcdd021" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:16 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a64a5d6-2ed6-4816-8719-e6edd8e4e1b9]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-95dc46d0-c92f-406c-a3e7-33f7dbcdd021 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:16 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-95dc46d0-c92f-406c-a3e7-33f7dbcdd021 Sep 17 15:04:16 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:16 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-95dc46d0-c92f-406c-a3e7-33f7dbcdd021" returned: 0 in 0.678s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-95dc46d0-c92f-406c-a3e7-33f7dbcdd021 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:16 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-95dc46d0-c92f-406c-a3e7-33f7dbcdd021 Sep 17 15:04:16 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:17 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-95dc46d0-c92f-406c-a3e7-33f7dbcdd021" returned: 0 in 0.397s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] Lock "cinder-quobyte-95dc46d0-c92f-406c-a3e7-33f7dbcdd021" released by "delete_volume" :: held 1.144s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:17 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] Created reservations ['67a159a8-cf83-48ae-9d85-bf9b82e3fc81', 'def34d32-0009-4f20-ae66-563fdb2b842c', 'a80b5cf8-d3b3-4343-a655-b98fae3d9306', '692156a4-dce7-482e-babc-270f6ea67da2'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:17 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:04:17 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:17 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.320s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:17 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:17 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] Deleted volume successfully. Sep 17 15:04:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0c25f421-9f13-4c15-90db-e2224fd11944 tempest-VolumesGetTest-1482151823 None] Lock "cinder-95dc46d0-c92f-406c-a3e7-33f7dbcdd021-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] Acquiring lock "cinder-dfded238-bf51-428b-b013-f02e1d16649c-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] Lock "cinder-dfded238-bf51-428b-b013-f02e1d16649c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] Acquiring lock "cinder-quobyte-dfded238-bf51-428b-b013-f02e1d16649c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] Lock "cinder-quobyte-dfded238-bf51-428b-b013-f02e1d16649c" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:18 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb19d54-c89d-4ba6-bb41-63ad4e861a30]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:18 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c Sep 17 15:04:18 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:19 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c" returned: 0 in 0.687s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:19 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c Sep 17 15:04:19 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:20 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-dfded238-bf51-428b-b013-f02e1d16649c" returned: 0 in 0.751s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] Lock "cinder-quobyte-dfded238-bf51-428b-b013-f02e1d16649c" released by "delete_volume" :: held 1.549s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Flow 'volume_create_manager' (3d4f33bd-0007-4c96-9bf2-4e1e70342043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bc3c70-c3ff-44cd-b0a0-eb34531d2dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5bc3c70-c3ff-44cd-b0a0-eb34531d2dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-294065280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ebb263a-f72f-4852-af6f-2ad06c0061a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffb7cf2144c94d5fbc0925564117ed45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:20Z,use_quota=True,user_id='8d3785d8f6ad468f94195c9a8e6c8063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df03867b-426a-4480-872d-a49ef470d069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df03867b-426a-4480-872d-a49ef470d069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98828c0f-c724-49d1-97b9-653c89cd4662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98828c0f-c724-49d1-97b9-653c89cd4662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ebb263a-f72f-4852-af6f-2ad06c0061a9', 'volume_name': 'volume-5ebb263a-f72f-4852-af6f-2ad06c0061a9', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b709916c-f436-46ff-a890-c49050633c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b709916c-f436-46ff-a890-c49050633c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7482258d-e990-442b-a9c6-3efd14a19a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:20 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Volume 5ebb263a-f72f-4852-af6f-2ad06c0061a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ebb263a-f72f-4852-af6f-2ad06c0061a9', 'volume_size': 1} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] Created reservations ['32d229f1-faf5-49f8-883b-1472dd3d9a5a', '62e4a5a7-6c23-4662-a360-ec170f430b7f', 'aa539ef6-97f9-4f1d-b04b-de076c3af05c', '2987a0a7-4f33-4e1d-89ca-04a4d311293f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:20 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:04:20 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:21 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.602s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:21 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] Deleted volume successfully. Sep 17 15:04:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-560439f9-84d3-4f45-a430-27274ee1340e tempest-VolumesGetTest-1482151823 None] Lock "cinder-dfded238-bf51-428b-b013-f02e1d16649c-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Flow 'volume_create_manager' (e258f559-40e1-4042-98f9-faef027e9209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8eef95-e584-411c-92c3-fc0b0c4fee23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c8eef95-e584-411c-92c3-fc0b0c4fee23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-664672377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e9050a5-802f-4f01-aed9-c97474919bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='413e266893ce4c32bef2578a0872ab46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:24Z,use_quota=True,user_id='2eb56de5708a4368a764928d161d5a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca230d3-1766-4ded-b48a-3bba074c2bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca230d3-1766-4ded-b48a-3bba074c2bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae9317d-4b67-4c46-ae77-cf8ce22110e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae9317d-4b67-4c46-ae77-cf8ce22110e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e9050a5-802f-4f01-aed9-c97474919bd3', 'volume_name': 'volume-1e9050a5-802f-4f01-aed9-c97474919bd3', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59d4a8e-8969-4e72-963a-8278e060d19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59d4a8e-8969-4e72-963a-8278e060d19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d77317-91f0-471b-b2b5-12672a88a7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:24 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Volume 1e9050a5-802f-4f01-aed9-c97474919bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e9050a5-802f-4f01-aed9-c97474919bd3', 'volume_size': 1} Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:24 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.8fdc61d3-996c-4b1d-a583-960a65660000k51t9cwt.img" returned: 0 in 8.465s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca107e40-079b-495b-94e1-16596a386e74]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:24 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e Sep 17 15:04:24 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:24 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e" returned: 0 in 0.601s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] Image conversion details: src /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e, size 1024.00 MB, duration 8.47 sec, destination /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.8fdc61d3-996c-4b1d-a583-960a65660000k51t9cwt.img {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:04:24 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] Converted 1024.00 MB image at 120.96 MB/s Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] 8fdc61d3-996c-4b1d-a583-960a65660000 was raw, converting to qcow2 {{(pid=86082) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0345a08-9c2f-40c5-ab20-ceb40d39df6a]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.8fdc61d3-996c-4b1d-a583-960a65660000k51t9cwt.img {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:25 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.8fdc61d3-996c-4b1d-a583-960a65660000k51t9cwt.img Sep 17 15:04:25 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:25 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.8fdc61d3-996c-4b1d-a583-960a65660000k51t9cwt.img" returned: 0 in 0.330s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.8fdc61d3-996c-4b1d-a583-960a65660000k51t9cwt.img {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:25 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.8fdc61d3-996c-4b1d-a583-960a65660000k51t9cwt.img Sep 17 15:04:25 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:25 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.8fdc61d3-996c-4b1d-a583-960a65660000k51t9cwt.img" returned: 1 in 0.336s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.8fdc61d3-996c-4b1d-a583-960a65660000k51t9cwt.img' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:04:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.8fdc61d3-996c-4b1d-a583-960a65660000k51t9cwt.img /opt/stack/data/cinder/conversion/vol_upload_mevtkcuz {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:25 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.8fdc61d3-996c-4b1d-a583-960a65660000k51t9cwt.img /opt/stack/data/cinder/conversion/vol_upload_mevtkcuz Sep 17 15:04:25 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:25 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.8fdc61d3-996c-4b1d-a583-960a65660000k51t9cwt.img /opt/stack/data/cinder/conversion/vol_upload_mevtkcuz" returned: 0 in 0.271s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:25 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] Image conversion details: src /opt/stack/data/cinder/conversion/165cfa55-f087-4e08-84c8-c8bf6fa19f3e.temp_image.8fdc61d3-996c-4b1d-a583-960a65660000k51t9cwt.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_mevtkcuz {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:04:25 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 17 15:04:25 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a326cd1-4ae8-4afb-81c9-abf95ab548b0]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mevtkcuz {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:25 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mevtkcuz Sep 17 15:04:25 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:26 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mevtkcuz" returned: 0 in 0.364s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.688s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] Uploaded volume to glance image-id: 8fdc61d3-996c-4b1d-a583-960a65660000. {{(pid=86082) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 17 15:04:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.426s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-294065280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ebb263a-f72f-4852-af6f-2ad06c0061a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffb7cf2144c94d5fbc0925564117ed45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:20Z,use_quota=True,user_id='8d3785d8f6ad468f94195c9a8e6c8063',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:04:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Creating volume 5ebb263a-f72f-4852-af6f-2ad06c0061a9 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:04:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:04:27 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:04:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ebb263a-f72f-4852-af6f-2ad06c0061a9 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:27 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ebb263a-f72f-4852-af6f-2ad06c0061a9 1073741824 Sep 17 15:04:27 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b9d660a2-ca86-47f5-98e0-e182d8b57362 tempest-VolumesActionsTest-1341087722 None] Copy volume to image completed successfully. Sep 17 15:04:28 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ebb263a-f72f-4852-af6f-2ad06c0061a9 1073741824" returned: 0 in 0.492s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ebb263a-f72f-4852-af6f-2ad06c0061a9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:28 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ebb263a-f72f-4852-af6f-2ad06c0061a9 Sep 17 15:04:28 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:28 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ebb263a-f72f-4852-af6f-2ad06c0061a9" returned: 0 in 0.277s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.302s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-664672377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e9050a5-802f-4f01-aed9-c97474919bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='413e266893ce4c32bef2578a0872ab46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:24Z,use_quota=True,user_id='2eb56de5708a4368a764928d161d5a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Creating volume 1e9050a5-802f-4f01-aed9-c97474919bd3 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:04:28 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1e9050a5-802f-4f01-aed9-c97474919bd3 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] Acquiring lock "cinder-165cfa55-f087-4e08-84c8-c8bf6fa19f3e-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:28 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1e9050a5-802f-4f01-aed9-c97474919bd3 1073741824 Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7482258d-e990-442b-a9c6-3efd14a19a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ebb263a-f72f-4852-af6f-2ad06c0061a9', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:28 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4525daab-3d68-4b38-9eab-e3213112d1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] Lock "cinder-165cfa55-f087-4e08-84c8-c8bf6fa19f3e-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:28 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Volume volume-5ebb263a-f72f-4852-af6f-2ad06c0061a9 (5ebb263a-f72f-4852-af6f-2ad06c0061a9): created successfully Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4525daab-3d68-4b38-9eab-e3213112d1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Flow 'volume_create_manager' (3d4f33bd-0007-4c96-9bf2-4e1e70342043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9651d74a-dc16-45ba-a34f-26a3506f192d tempest-AttachVolumeNegativeTest-2049608112 None] Created volume successfully. Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] Acquiring lock "cinder-quobyte-165cfa55-f087-4e08-84c8-c8bf6fa19f3e" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] Lock "cinder-quobyte-165cfa55-f087-4e08-84c8-c8bf6fa19f3e" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2a20ed-1262-433b-b0ba-c11241387dbe]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:28 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e Sep 17 15:04:28 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:29 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1e9050a5-802f-4f01-aed9-c97474919bd3 1073741824" returned: 0 in 0.599s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:29 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1e9050a5-802f-4f01-aed9-c97474919bd3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e" returned: 0 in 0.437s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:29 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1e9050a5-802f-4f01-aed9-c97474919bd3 Sep 17 15:04:29 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:29 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e Sep 17 15:04:29 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:29 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1e9050a5-802f-4f01-aed9-c97474919bd3" returned: 0 in 0.256s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d77317-91f0-471b-b2b5-12672a88a7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e9050a5-802f-4f01-aed9-c97474919bd3', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e4eb38-ee90-45b9-aaa8-13ffa9f8247e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:29 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Volume volume-1e9050a5-802f-4f01-aed9-c97474919bd3 (1e9050a5-802f-4f01-aed9-c97474919bd3): created successfully Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e4eb38-ee90-45b9-aaa8-13ffa9f8247e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:29 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Flow 'volume_create_manager' (e258f559-40e1-4042-98f9-faef027e9209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-165cfa55-f087-4e08-84c8-c8bf6fa19f3e" returned: 0 in 0.295s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] Lock "cinder-quobyte-165cfa55-f087-4e08-84c8-c8bf6fa19f3e" released by "delete_volume" :: held 0.799s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a7bf5d43-1bc5-41dc-9733-6fa36b9e9531 tempest-AttachVolumeTestJSON-1182212184 None] Created volume successfully. Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] Created reservations ['679cf8c8-7bc7-43ee-a78b-35651888ea46', '309f4fc7-0f80-4d1f-9179-73bfacfafccd', 'deffa395-a1e0-49db-a76f-55ad6016e648', '2e226da4-f3e8-42ff-a0b3-73e0aea33f39'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:29 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:04:29 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:29 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.318s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:29 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:30 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] Deleted volume successfully. Sep 17 15:04:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c2444e74-4cd9-4568-b6a1-76edc48d1596 tempest-VolumesActionsTest-1341087722 None] Lock "cinder-165cfa55-f087-4e08-84c8-c8bf6fa19f3e-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-bdeece6d-5067-42a0-a283-a4c19ec76c4b req-fb9e10c1-63e6-4d9e-a82e-3f827fbee545 tempest-AttachVolumeNegativeTest-2049608112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-bdeece6d-5067-42a0-a283-a4c19ec76c4b req-fb9e10c1-63e6-4d9e-a82e-3f827fbee545 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-bdeece6d-5067-42a0-a283-a4c19ec76c4b req-fb9e10c1-63e6-4d9e-a82e-3f827fbee545 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-bdeece6d-5067-42a0-a283-a4c19ec76c4b req-fb9e10c1-63e6-4d9e-a82e-3f827fbee545 tempest-AttachVolumeNegativeTest-2049608112 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-5ebb263a-f72f-4852-af6f-2ad06c0061a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a0949ff-ad76-4951-98c4-57251db0d820', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:04:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-bdeece6d-5067-42a0-a283-a4c19ec76c4b req-fb9e10c1-63e6-4d9e-a82e-3f827fbee545 tempest-AttachVolumeNegativeTest-2049608112 None] attachment_update completed successfully. Sep 17 15:04:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-07d8272a-7da4-4c29-80a7-e9fcbf03b593 req-f7f30b2c-55e5-48e3-a512-0bb99d619036 tempest-AttachVolumeTestJSON-1182212184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-07d8272a-7da4-4c29-80a7-e9fcbf03b593 req-f7f30b2c-55e5-48e3-a512-0bb99d619036 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-07d8272a-7da4-4c29-80a7-e9fcbf03b593 req-f7f30b2c-55e5-48e3-a512-0bb99d619036 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-07d8272a-7da4-4c29-80a7-e9fcbf03b593 req-f7f30b2c-55e5-48e3-a512-0bb99d619036 tempest-AttachVolumeTestJSON-1182212184 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-1e9050a5-802f-4f01-aed9-c97474919bd3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e32a7b6-575d-4890-8088-46e86200f354', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:04:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-07d8272a-7da4-4c29-80a7-e9fcbf03b593 req-f7f30b2c-55e5-48e3-a512-0bb99d619036 tempest-AttachVolumeTestJSON-1182212184 None] attachment_update completed successfully. Sep 17 15:04:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-800d13b2-5239-40c7-88a3-481b4480bafa req-03a778ee-bc93-4752-9e6f-137a6bb463f3 tempest-AttachVolumeNegativeTest-2049608112 None] Terminate volume connection completed successfully. Sep 17 15:04:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-800d13b2-5239-40c7-88a3-481b4480bafa req-03a778ee-bc93-4752-9e6f-137a6bb463f3 tempest-AttachVolumeNegativeTest-2049608112 None] Deleting attachment 7a0949ff-ad76-4951-98c4-57251db0d820. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Flow 'volume_create_manager' (f9e6aa11-a387-4975-bfb8-34a561d1a555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc0f2ce-4caf-4fca-9ac4-8171110c7fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fc0f2ce-4caf-4fca-9ac4-8171110c7fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1311199886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936803c9-2846-4687-9f1c-e0bfad9b66d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2750af9d9645d7b5fb328d2b1fd37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:39Z,use_quota=True,user_id='b77d4b9e12c14135a67fbf87bd364508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6877ac92-9f41-4b02-aee2-ff5894e5f251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6877ac92-9f41-4b02-aee2-ff5894e5f251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4cbdbe3-0ac4-46e6-80ce-a022fb3d7e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4cbdbe3-0ac4-46e6-80ce-a022fb3d7e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '936803c9-2846-4687-9f1c-e0bfad9b66d9', 'volume_name': 'volume-936803c9-2846-4687-9f1c-e0bfad9b66d9', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1a516e-1331-47d5-89c4-c0c25d18e307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1a516e-1331-47d5-89c4-c0c25d18e307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439c5637-3f6e-465b-900f-239fc579aaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:39 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Volume 936803c9-2846-4687-9f1c-e0bfad9b66d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-936803c9-2846-4687-9f1c-e0bfad9b66d9', 'volume_size': 1} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1311199886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936803c9-2846-4687-9f1c-e0bfad9b66d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2750af9d9645d7b5fb328d2b1fd37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:39Z,use_quota=True,user_id='b77d4b9e12c14135a67fbf87bd364508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Creating volume 936803c9-2846-4687-9f1c-e0bfad9b66d9 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:04:39 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:04:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:39 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9 1073741824 Sep 17 15:04:39 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:40 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9 1073741824" returned: 0 in 0.613s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:40 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9 Sep 17 15:04:40 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:04:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:40 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9" returned: 0 in 0.333s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:04:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:40 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:04:40 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (439c5637-3f6e-465b-900f-239fc579aaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-936803c9-2846-4687-9f1c-e0bfad9b66d9', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a46eb6b7-b996-4f65-af13-e4b8ce04da67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:40 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Volume volume-936803c9-2846-4687-9f1c-e0bfad9b66d9 (936803c9-2846-4687-9f1c-e0bfad9b66d9): created successfully Sep 17 15:04:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a46eb6b7-b996-4f65-af13-e4b8ce04da67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Flow 'volume_create_manager' (f9e6aa11-a387-4975-bfb8-34a561d1a555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:40 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6bb6caef-d31e-406b-8038-3f6611c77477 tempest-VolumesSnapshotTestJSON-1278407807 None] Created volume successfully. Sep 17 15:04:40 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.608s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:41 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:04:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:04:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:04:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] Acquiring lock "cinder-5ebb263a-f72f-4852-af6f-2ad06c0061a9-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "cinder-5ebb263a-f72f-4852-af6f-2ad06c0061a9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] Acquiring lock "cinder-quobyte-5ebb263a-f72f-4852-af6f-2ad06c0061a9" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "cinder-quobyte-5ebb263a-f72f-4852-af6f-2ad06c0061a9" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:41 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dbd127-8ee0-4f56-8917-10efe16bff25]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ebb263a-f72f-4852-af6f-2ad06c0061a9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:42 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ebb263a-f72f-4852-af6f-2ad06c0061a9 Sep 17 15:04:42 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] Creating offline snapshot b29eabf0-4d9a-4c34-afd9-bc920e654ebc of volume 936803c9-2846-4687-9f1c-e0bfad9b66d9 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:04:42 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[500850ac-5f49-40e0-869b-c449da6d6a5f]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:42 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ebb263a-f72f-4852-af6f-2ad06c0061a9" returned: 0 in 0.588s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ebb263a-f72f-4852-af6f-2ad06c0061a9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:42 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9 Sep 17 15:04:42 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:42 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ebb263a-f72f-4852-af6f-2ad06c0061a9 Sep 17 15:04:42 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:43 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ebb263a-f72f-4852-af6f-2ad06c0061a9" returned: 0 in 0.570s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "cinder-quobyte-5ebb263a-f72f-4852-af6f-2ad06c0061a9" released by "delete_volume" :: held 1.239s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:43 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9" returned: 0 in 0.809s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:43 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc 1G Sep 17 15:04:43 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:43 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] Created reservations ['e3d9d9a4-f571-4ebb-bfa6-e9da2de005d6', '02aea649-76a9-4f14-9ca4-014edc3ecf50', 'ca9364a4-a242-4e00-a6f3-b1a921105b63', 'f52471b9-4ba0-4eba-b513-61b46bcf77da'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:43 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:04:43 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:44 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc 1G" returned: 0 in 0.785s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-936803c9-2846-4687-9f1c-e0bfad9b66d9 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:44 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.416s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:44 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] Deleted volume successfully. Sep 17 15:04:44 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-936803c9-2846-4687-9f1c-e0bfad9b66d9 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc Sep 17 15:04:44 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-26dc1ea3-ea4f-4a6e-aace-7d099fb86151 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "cinder-5ebb263a-f72f-4852-af6f-2ad06c0061a9-delete_volume" released by "delete_volume" :: held 2.267s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] Acquiring lock "cinder-76c05334-66ea-4fd3-9135-e281e2868d64-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] Lock "cinder-76c05334-66ea-4fd3-9135-e281e2868d64-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] Acquiring lock "cinder-quobyte-76c05334-66ea-4fd3-9135-e281e2868d64" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] Lock "cinder-quobyte-76c05334-66ea-4fd3-9135-e281e2868d64" acquired by "delete_volume" :: waited 0.041s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:44 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9beb8c-0ab8-47da-8f62-d8b87c3afc89]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76c05334-66ea-4fd3-9135-e281e2868d64 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:44 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-936803c9-2846-4687-9f1c-e0bfad9b66d9 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc" returned: 0 in 0.734s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:44 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc is being set with open permissions: ugo+rw Sep 17 15:04:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:44 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76c05334-66ea-4fd3-9135-e281e2868d64 Sep 17 15:04:44 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:44 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc Sep 17 15:04:44 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:44 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Flow 'volume_create_manager' (3678900a-816c-4d48-8a62-cc79ff45e72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03affee8-43bc-434f-a521-977371268d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03affee8-43bc-434f-a521-977371268d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2071640802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5753b81d-7adc-424c-8ade-a70ba3365618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3aa168088294ba0a725955c97b859e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:45Z,use_quota=True,user_id='7b037568b7be40a2b6239c57d2f5c843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57928ff7-d76d-4c56-802d-6905972ba78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57928ff7-d76d-4c56-802d-6905972ba78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9808d8ff-8c80-4e83-99f3-3783ee94209e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9808d8ff-8c80-4e83-99f3-3783ee94209e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5753b81d-7adc-424c-8ade-a70ba3365618', 'volume_name': 'volume-5753b81d-7adc-424c-8ade-a70ba3365618', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d96bb1f-4435-43be-9ad2-954b5eda92ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d96bb1f-4435-43be-9ad2-954b5eda92ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4fd9dfe-e366-43bf-960a-7cc6169661f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:45 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Volume 5753b81d-7adc-424c-8ade-a70ba3365618: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5753b81d-7adc-424c-8ade-a70ba3365618', 'volume_size': 1} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:45 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc" returned: 0 in 0.355s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:45 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76c05334-66ea-4fd3-9135-e281e2868d64" returned: 0 in 0.523s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76c05334-66ea-4fd3-9135-e281e2868d64 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:45 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76c05334-66ea-4fd3-9135-e281e2868d64 Sep 17 15:04:45 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:45 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.info Sep 17 15:04:45 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:45 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76c05334-66ea-4fd3-9135-e281e2868d64" returned: 0 in 0.273s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] Lock "cinder-quobyte-76c05334-66ea-4fd3-9135-e281e2868d64" released by "delete_volume" :: held 0.906s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:45 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.info" returned: 0 in 0.296s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:45 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.info is being set with open permissions: ugo+rw Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:45 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.info Sep 17 15:04:45 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] Created reservations ['817514d7-07f1-48ff-8549-f31abaeba0c8', 'c696a7af-f57e-4448-bc52-4ad17730a96b', 'a5b71d3a-0c27-405c-802e-2f7b9c9fb0c8', '5142538b-2953-4fa4-a954-87403b24876c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:45 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:04:45 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:45 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.info" returned: 0 in 0.391s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.585s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.869s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2071640802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5753b81d-7adc-424c-8ade-a70ba3365618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3aa168088294ba0a725955c97b859e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:45Z,use_quota=True,user_id='7b037568b7be40a2b6239c57d2f5c843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Creating volume 5753b81d-7adc-424c-8ade-a70ba3365618 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:04:45 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:04:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:45 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 1073741824 Sep 17 15:04:45 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-93529182-ef2d-426a-bc26-4374244fad0c tempest-VolumesSnapshotTestJSON-1278407807 None] Create snapshot completed successfully Sep 17 15:04:46 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.376s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:46 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] Deleted volume successfully. Sep 17 15:04:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] Acquiring lock "cinder-e3a422c8-1305-4853-9ded-dc8f9b7c4131-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9d4674e-c55b-4d9d-b5f1-144cdfb2a9eb tempest-AttachVolumeNegativeTest-2049608112 None] Lock "cinder-76c05334-66ea-4fd3-9135-e281e2868d64-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "cinder-e3a422c8-1305-4853-9ded-dc8f9b7c4131-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] Acquiring lock "cinder-quobyte-e3a422c8-1305-4853-9ded-dc8f9b7c4131" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "cinder-quobyte-e3a422c8-1305-4853-9ded-dc8f9b7c4131" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:46 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7e7769-bd33-4320-a06d-e291a631677e]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3a422c8-1305-4853-9ded-dc8f9b7c4131 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:46 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3a422c8-1305-4853-9ded-dc8f9b7c4131 Sep 17 15:04:46 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:46 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 1073741824" returned: 0 in 0.691s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:46 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 Sep 17 15:04:46 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:46 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3a422c8-1305-4853-9ded-dc8f9b7c4131" returned: 0 in 0.542s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3a422c8-1305-4853-9ded-dc8f9b7c4131 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:46 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3a422c8-1305-4853-9ded-dc8f9b7c4131 Sep 17 15:04:46 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-b29eabf0-4d9a-4c34-afd9-bc920e654ebc-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-b29eabf0-4d9a-4c34-afd9-bc920e654ebc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:47 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618" returned: 0 in 0.490s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4fd9dfe-e366-43bf-960a-7cc6169661f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5753b81d-7adc-424c-8ade-a70ba3365618', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:47 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11d454a-71fb-4d63-b6ed-4bdaba5dce6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3a422c8-1305-4853-9ded-dc8f9b7c4131" returned: 0 in 0.409s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-quobyte-936803c9-2846-4687-9f1c-e0bfad9b66d9" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:47 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Volume volume-5753b81d-7adc-424c-8ade-a70ba3365618 (5753b81d-7adc-424c-8ade-a70ba3365618): created successfully Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11d454a-71fb-4d63-b6ed-4bdaba5dce6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Flow 'volume_create_manager' (3678900a-816c-4d48-8a62-cc79ff45e72f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "cinder-quobyte-e3a422c8-1305-4853-9ded-dc8f9b7c4131" released by "delete_volume" :: held 1.035s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-936803c9-2846-4687-9f1c-e0bfad9b66d9" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-quobyte-b29eabf0-4d9a-4c34-afd9-bc920e654ebc" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:47 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-702d637a-bd27-4d12-bd53-17b1ee1dba7a tempest-VolumesCloneTest-1870050615 None] Created volume successfully. Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-b29eabf0-4d9a-4c34-afd9-bc920e654ebc" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] Deleting offline snapshot b29eabf0-4d9a-4c34-afd9-bc920e654ebc of volume 936803c9-2846-4687-9f1c-e0bfad9b66d9 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] snapshot_file for this snap is: volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4248274f-f7b7-4aa3-ac3b-dcf8df198909]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] Created reservations ['c25c0ef8-5c7b-46e7-8e4b-e445db21b587', 'ad166397-0963-4bb8-a372-702a90c61981', '24c820f8-406f-455b-a34a-8e39eecbd80f', '95e6998d-0614-4501-9630-3ff46ce78b28'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:47 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc Sep 17 15:04:47 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:47 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:04:47 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:47 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.302s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:47 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] Deleted volume successfully. Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-438f4c96-be0e-4c02-a0bf-dd96bc59ca44 tempest-AttachVolumeNegativeTest-2049608112 None] Lock "cinder-e3a422c8-1305-4853-9ded-dc8f9b7c4131-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:47 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc" returned: 0 in 0.520s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-936803c9-2846-4687-9f1c-e0bfad9b66d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f7ee21-96e3-4aed-98f1-1bb43c814b09]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:48 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9 Sep 17 15:04:48 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:48 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Flow 'volume_create_manager' (58469de5-584d-4c36-ab6e-c1c0c99f6d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2861237-1b60-4074-b399-4eb3af19d1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9" returned: 0 in 0.460s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:48 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc Sep 17 15:04:48 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2861237-1b60-4074-b399-4eb3af19d1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-368383258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc1e099-1ebb-4efc-86a4-6ad013543689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3aa168088294ba0a725955c97b859e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=5753b81d-7adc-424c-8ade-a70ba3365618,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:48Z,use_quota=True,user_id='7b037568b7be40a2b6239c57d2f5c843',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f2aa94-d869-4ae2-8afc-1385e59553c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f2aa94-d869-4ae2-8afc-1385e59553c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4efaaf8e-dd22-4ac4-80ee-0869db6fbecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4efaaf8e-dd22-4ac4-80ee-0869db6fbecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ecc1e099-1ebb-4efc-86a4-6ad013543689', 'volume_name': 'volume-ecc1e099-1ebb-4efc-86a4-6ad013543689', 'volume_size': 2, 'source_volid': '5753b81d-7adc-424c-8ade-a70ba3365618', 'source_volstatus': 'available'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e3e6e1-b7e9-4f20-877b-4e926a60cf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e3e6e1-b7e9-4f20-877b-4e926a60cf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5524a473-706c-4d6a-ba83-00f04ab20e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:48 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Volume ecc1e099-1ebb-4efc-86a4-6ad013543689: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ecc1e099-1ebb-4efc-86a4-6ad013543689', 'volume_size': 2, 'source_volid': '5753b81d-7adc-424c-8ade-a70ba3365618', 'source_volstatus': 'available'} Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:48 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Cloning volume 5753b81d-7adc-424c-8ade-a70ba3365618 to volume ecc1e099-1ebb-4efc-86a4-6ad013543689 Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Creating offline snapshot 4e879951-5175-430d-9e5e-ef655fe895cb of volume 5753b81d-7adc-424c-8ade-a70ba3365618 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[336654de-00fe-4923-a874-1c225b02c2f3]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:48 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 Sep 17 15:04:48 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:48 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc" returned: 0 in 0.384s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:48 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc Sep 17 15:04:48 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:49 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618" returned: 0 in 0.431s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:49 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb 1G Sep 17 15:04:49 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:49 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9.b29eabf0-4d9a-4c34-afd9-bc920e654ebc" returned: 0 in 0.271s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-b29eabf0-4d9a-4c34-afd9-bc920e654ebc" released by "_delete_snapshot" :: held 1.773s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-936803c9-2846-4687-9f1c-e0bfad9b66d9" released by "delete_snapshot" :: held 1.813s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:49 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] Created reservations ['2c1d33f8-1242-4205-93fc-0bb1c6b328c4', '6adcb53d-7c17-402d-b683-bbe76f5d39bf', '04c2309b-6653-48ba-93b4-4cd92721cc1d', 'f06aece7-5751-4fd3-bafe-000348e39c5f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:49 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] Delete snapshot completed successfully. Sep 17 15:04:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb6c2cab-a2f4-4d13-b31f-09b312af5185 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-b29eabf0-4d9a-4c34-afd9-bc920e654ebc-delete_snapshot" released by "delete_snapshot" :: held 2.231s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:49 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb 1G" returned: 0 in 0.558s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5753b81d-7adc-424c-8ade-a70ba3365618 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:49 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5753b81d-7adc-424c-8ade-a70ba3365618 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb Sep 17 15:04:49 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:49 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5753b81d-7adc-424c-8ade-a70ba3365618 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb" returned: 0 in 0.330s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:49 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb is being set with open permissions: ugo+rw Sep 17 15:04:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:49 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb Sep 17 15:04:49 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:50 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb" returned: 0 in 0.297s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:50 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.info Sep 17 15:04:50 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:50 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.info" returned: 0 in 0.338s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:50 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.info is being set with open permissions: ugo+rw Sep 17 15:04:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:50 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.info Sep 17 15:04:50 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:50 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.info" returned: 0 in 0.297s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Acquiring lock "cinder-quobyte-ecc1e099-1ebb-4efc-86a4-6ad013543689" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Lock "cinder-quobyte-ecc1e099-1ebb-4efc-86a4-6ad013543689" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] snapshot: 4e879951-5175-430d-9e5e-ef655fe895cb, volume: ecc1e099-1ebb-4efc-86a4-6ad013543689, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:04:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[30356b83-61be-4c0b-a20b-b6e00c5f3d88]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:51 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb Sep 17 15:04:51 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Flow 'volume_create_manager' (66b409cc-6f88-4b2d-a3d0-c8604aaf3cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa04583-38cb-466e-ab3d-a82e5a520956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa04583-38cb-466e-ab3d-a82e5a520956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1530800525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e257edd-87f1-4906-8333-a81300bfa922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2750af9d9645d7b5fb328d2b1fd37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:51Z,use_quota=True,user_id='b77d4b9e12c14135a67fbf87bd364508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55fa184-7a74-462c-9ad6-c481f07d356b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55fa184-7a74-462c-9ad6-c481f07d356b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1998e5d2-4897-46a6-a555-8e5ebf573ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1998e5d2-4897-46a6-a555-8e5ebf573ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e257edd-87f1-4906-8333-a81300bfa922', 'volume_name': 'volume-0e257edd-87f1-4906-8333-a81300bfa922', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de64fd5-ab4c-4675-8c92-abe6d3817e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de64fd5-ab4c-4675-8c92-abe6d3817e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a069f0c1-d358-448b-97d5-8ac2680b594d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Volume 0e257edd-87f1-4906-8333-a81300bfa922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e257edd-87f1-4906-8333-a81300bfa922', 'volume_size': 1} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:51 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb" returned: 0 in 0.483s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5753b81d-7adc-424c-8ade-a70ba3365618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[358bac1f-0040-44c9-a7db-7bfb0dbaec57]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:51 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 Sep 17 15:04:51 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:51 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618" returned: 0 in 0.396s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Path /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ecc1e099-1ebb-4efc-86a4-6ad013543689 not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:04:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ecc1e099-1ebb-4efc-86a4-6ad013543689 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:51 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ecc1e099-1ebb-4efc-86a4-6ad013543689 Sep 17 15:04:51 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:00 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ecc1e099-1ebb-4efc-86a4-6ad013543689" returned: 0 in 8.353s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:00 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Image conversion details: src /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618, size 1024.00 MB, duration 8.35 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ecc1e099-1ebb-4efc-86a4-6ad013543689 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:05:00 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Converted 1024.00 MB image at 122.57 MB/s Sep 17 15:05:00 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ecc1e099-1ebb-4efc-86a4-6ad013543689 is being set with open permissions: ugo+rw Sep 17 15:05:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ecc1e099-1ebb-4efc-86a4-6ad013543689 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:00 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ecc1e099-1ebb-4efc-86a4-6ad013543689 Sep 17 15:05:00 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:00 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ecc1e099-1ebb-4efc-86a4-6ad013543689" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Lock "cinder-quobyte-ecc1e099-1ebb-4efc-86a4-6ad013543689" released by "_copy_volume_from_snapshot" :: held 9.581s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Acquiring lock "cinder-quobyte-4e879951-5175-430d-9e5e-ef655fe895cb" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Lock "cinder-quobyte-4e879951-5175-430d-9e5e-ef655fe895cb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Deleting offline snapshot 4e879951-5175-430d-9e5e-ef655fe895cb of volume 5753b81d-7adc-424c-8ade-a70ba3365618 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:05:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] snapshot_file for this snap is: volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:05:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdd1392-3bc3-4c1e-a709-035ceba4600f]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:00 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb Sep 17 15:05:00 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:00 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb" returned: 0 in 0.386s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5753b81d-7adc-424c-8ade-a70ba3365618(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e172dd4e-b4e5-4ceb-a28a-edda0f482154]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:01 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 Sep 17 15:05:01 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=79,cinder:UPDATE=73,cinder:DELETE=7,cinder:INSERT=16 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Flow 'volume_create_manager' (e9e10131-79f9-46dc-b4ca-0a4ff83ec108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9f3fc8-c222-44f3-aea2-12c6b948be2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9f3fc8-c222-44f3-aea2-12c6b948be2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1981320794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a25fcd-efea-40b4-b2c0-16629650c2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d6f3340eed479797f89af2ca33712b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:01Z,use_quota=True,user_id='93b1e95f6b9f4795b6e620719be8d42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6486683c-9fb8-4b63-9dde-44b5f22301ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6486683c-9fb8-4b63-9dde-44b5f22301ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d0086e-b66b-4ede-8ce8-1002abc3f1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d0086e-b66b-4ede-8ce8-1002abc3f1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36a25fcd-efea-40b4-b2c0-16629650c2ec', 'volume_name': 'volume-36a25fcd-efea-40b4-b2c0-16629650c2ec', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a59bb6-bcb9-4b6e-8bb1-17bf141779c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a59bb6-bcb9-4b6e-8bb1-17bf141779c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cda8fe9-21a3-4d3a-ba80-6a15df048061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:01 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Volume 36a25fcd-efea-40b4-b2c0-16629650c2ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36a25fcd-efea-40b4-b2c0-16629650c2ec', 'volume_size': 1} Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:01 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618" returned: 0 in 0.594s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:01 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb Sep 17 15:05:01 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:01 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb" returned: 0 in 0.340s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:01 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb Sep 17 15:05:01 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:02 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618.4e879951-5175-430d-9e5e-ef655fe895cb" returned: 0 in 0.257s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Lock "cinder-quobyte-4e879951-5175-430d-9e5e-ef655fe895cb" released by "_delete_snapshot" :: held 1.686s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.781s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.034s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1530800525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e257edd-87f1-4906-8333-a81300bfa922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2750af9d9645d7b5fb328d2b1fd37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:51Z,use_quota=True,user_id='b77d4b9e12c14135a67fbf87bd364508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Creating volume 0e257edd-87f1-4906-8333-a81300bfa922 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:05:02 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5524a473-706c-4d6a-ba83-00f04ab20e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc1e099-1ebb-4efc-86a4-6ad013543689', 'volume_size': 2, 'source_volid': '5753b81d-7adc-424c-8ade-a70ba3365618', 'source_volstatus': 'available'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:02 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 1073741824 Sep 17 15:05:02 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858650e1-aa42-45de-a38d-c9c2bc7e8ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:02 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Volume volume-ecc1e099-1ebb-4efc-86a4-6ad013543689 (ecc1e099-1ebb-4efc-86a4-6ad013543689): created successfully Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858650e1-aa42-45de-a38d-c9c2bc7e8ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Flow 'volume_create_manager' (58469de5-584d-4c36-ab6e-c1c0c99f6d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:02 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f58ff1cb-12eb-4274-825f-9658de14c1e7 tempest-VolumesCloneTest-1870050615 None] Created volume successfully. Sep 17 15:05:02 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 1073741824" returned: 0 in 0.468s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:02 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 Sep 17 15:05:02 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:03 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922" returned: 0 in 0.249s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.450s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1981320794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a25fcd-efea-40b4-b2c0-16629650c2ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33d6f3340eed479797f89af2ca33712b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:01Z,use_quota=True,user_id='93b1e95f6b9f4795b6e620719be8d42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Creating volume 36a25fcd-efea-40b4-b2c0-16629650c2ec {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:05:03 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a069f0c1-d358-448b-97d5-8ac2680b594d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e257edd-87f1-4906-8333-a81300bfa922', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:03 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec 1073741824 Sep 17 15:05:03 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f164aa9-f746-4c6b-a849-35370c2632b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] Acquiring lock "cinder-ecc1e099-1ebb-4efc-86a4-6ad013543689-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:03 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Volume volume-0e257edd-87f1-4906-8333-a81300bfa922 (0e257edd-87f1-4906-8333-a81300bfa922): created successfully Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f164aa9-f746-4c6b-a849-35370c2632b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Flow 'volume_create_manager' (66b409cc-6f88-4b2d-a3d0-c8604aaf3cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] Lock "cinder-ecc1e099-1ebb-4efc-86a4-6ad013543689-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d01596ed-7bd9-4165-9328-60013c54f669 tempest-VolumesSnapshotTestJSON-1278407807 None] Created volume successfully. Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] Acquiring lock "cinder-quobyte-ecc1e099-1ebb-4efc-86a4-6ad013543689" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] Lock "cinder-quobyte-ecc1e099-1ebb-4efc-86a4-6ad013543689" acquired by "delete_volume" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[080c68bd-c991-4d10-8a74-5e67d50fd643]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ecc1e099-1ebb-4efc-86a4-6ad013543689 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:03 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ecc1e099-1ebb-4efc-86a4-6ad013543689 Sep 17 15:05:03 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:03 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec 1073741824" returned: 0 in 0.544s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:03 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ecc1e099-1ebb-4efc-86a4-6ad013543689" returned: 0 in 0.434s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ecc1e099-1ebb-4efc-86a4-6ad013543689 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:03 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec Sep 17 15:05:03 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:03 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ecc1e099-1ebb-4efc-86a4-6ad013543689 Sep 17 15:05:03 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:03 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.297s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:03 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] Creating offline snapshot 7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 of volume 0e257edd-87f1-4906-8333-a81300bfa922 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ecc1e099-1ebb-4efc-86a4-6ad013543689" returned: 0 in 0.267s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cda8fe9-21a3-4d3a-ba80-6a15df048061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36a25fcd-efea-40b4-b2c0-16629650c2ec', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a30509-0464-4802-8fc8-437f86007c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[72287c0e-2cc1-40bf-9a8a-3f896984a06b]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] Lock "cinder-quobyte-ecc1e099-1ebb-4efc-86a4-6ad013543689" released by "delete_volume" :: held 0.776s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:03 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Volume volume-36a25fcd-efea-40b4-b2c0-16629650c2ec (36a25fcd-efea-40b4-b2c0-16629650c2ec): created successfully Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a30509-0464-4802-8fc8-437f86007c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Flow 'volume_create_manager' (e9e10131-79f9-46dc-b4ca-0a4ff83ec108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:04 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-29b69958-aeb3-4e3e-bfa7-6961e1681914 tempest-SnapshotsActionsTest-573001935 None] Created volume successfully. Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] Created reservations ['a274224d-75d2-4182-a531-403ff563ea4d', 'cfb94c3d-fc01-4469-9453-88412d84ea76', '3fdec360-b838-4e40-97a9-3d7158b45fce', '9a604a2f-7be2-4d04-b898-211518d65498'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:04 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 Sep 17 15:05:04 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:04 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:05:04 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] Acquiring lock "cinder-5753b81d-7adc-424c-8ade-a70ba3365618-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:04 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:04 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922" returned: 0 in 0.408s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.258s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:04 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] Deleted volume successfully. Sep 17 15:05:04 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 1G Sep 17 15:05:04 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] Lock "cinder-5753b81d-7adc-424c-8ade-a70ba3365618-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-60edcc55-b00d-42b5-ad93-01be5bd3ed52 tempest-VolumesCloneTest-1870050615 None] Lock "cinder-ecc1e099-1ebb-4efc-86a4-6ad013543689-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] Acquiring lock "cinder-quobyte-5753b81d-7adc-424c-8ade-a70ba3365618" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] Lock "cinder-quobyte-5753b81d-7adc-424c-8ade-a70ba3365618" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[15013ce3-c0b2-4462-a643-12ce341fe553]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:04 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 Sep 17 15:05:04 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:04 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 1G" returned: 0 in 0.584s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e257edd-87f1-4906-8333-a81300bfa922 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:04 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e257edd-87f1-4906-8333-a81300bfa922 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 Sep 17 15:05:04 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:05 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618" returned: 0 in 0.508s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:05 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618 Sep 17 15:05:05 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:05 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e257edd-87f1-4906-8333-a81300bfa922 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8" returned: 0 in 0.351s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:05 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 is being set with open permissions: ugo+rw Sep 17 15:05:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:05 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5753b81d-7adc-424c-8ade-a70ba3365618" returned: 0 in 0.288s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:05 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 Sep 17 15:05:05 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] Lock "cinder-quobyte-5753b81d-7adc-424c-8ade-a70ba3365618" released by "delete_volume" :: held 0.888s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:05 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] Created reservations ['739c7d65-de06-40a0-b9e3-34b67e6dbbb7', 'eed7b99a-375e-4e46-9f24-d7ed72059736', '35ff7468-fde0-46d8-84ed-01af536022e7', 'e60d844a-41da-473c-9332-253ecb1f3270'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:05 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:05:05 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:05 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8" returned: 0 in 0.332s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:05 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.info Sep 17 15:05:05 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:05 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.449s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:05 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:06 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] Deleted volume successfully. Sep 17 15:05:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c25b4663-8e88-423c-b6cb-20d015220cb6 tempest-VolumesCloneTest-1870050615 None] Lock "cinder-5753b81d-7adc-424c-8ade-a70ba3365618-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:06 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.info" returned: 0 in 0.469s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:06 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.info is being set with open permissions: ugo+rw Sep 17 15:05:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:06 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.info Sep 17 15:05:06 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:06 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.info" returned: 0 in 0.272s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.566s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.550s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] Creating offline snapshot f84cb9a8-1655-46a5-8557-b78c2434a623 of volume 36a25fcd-efea-40b4-b2c0-16629650c2ec {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:05:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[161d2eb6-fc17-425d-b6a1-65bc5b133d75]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:06 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fc1a2244-8a1e-4337-9002-d260d7f4498a tempest-VolumesSnapshotTestJSON-1278407807 None] Create snapshot completed successfully Sep 17 15:05:06 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=100,cinder:INSERT=27,cinder:SELECT=96,cinder:DELETE=8 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:05:06 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-b5bc45b3-28e2-4c9d-8bf0-6467ea85cd46 req-015d1a06-cd5d-471f-9da7-55091811bebc tempest-AttachVolumeTestJSON-1182212184 None] Terminate volume connection completed successfully. Sep 17 15:05:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-b5bc45b3-28e2-4c9d-8bf0-6467ea85cd46 req-015d1a06-cd5d-471f-9da7-55091811bebc tempest-AttachVolumeTestJSON-1182212184 None] Deleting attachment 5e32a7b6-575d-4890-8088-46e86200f354. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:05:06 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec Sep 17 15:05:06 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:06 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec" returned: 0 in 0.457s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:07 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 1G Sep 17 15:05:07 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:07 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:05:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Flow 'volume_create_manager' (a834954a-0cb1-4a9b-8053-02b067a6b520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (709b0581-b2c9-4651-8293-774d0f99a6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (709b0581-b2c9-4651-8293-774d0f99a6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1472289654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e8a8b9-1c29-4a51-987c-1b7f295415b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2750af9d9645d7b5fb328d2b1fd37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7e47eeec-8bdd-4a48-a9e4-9b46356d49e8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:07Z,use_quota=True,user_id='b77d4b9e12c14135a67fbf87bd364508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58cb814-abbd-426e-9e72-9acc7cd892d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58cb814-abbd-426e-9e72-9acc7cd892d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e338ca-4e3c-4338-ab75-00565e62bccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e338ca-4e3c-4338-ab75-00565e62bccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '50e8a8b9-1c29-4a51-987c-1b7f295415b4', 'volume_name': 'volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4', 'volume_size': 2, 'snapshot_id': '7e47eeec-8bdd-4a48-a9e4-9b46356d49e8'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:07 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27bdb5c6-c7b4-483e-9baa-c5038c3b8c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27bdb5c6-c7b4-483e-9baa-c5038c3b8c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f7b64d-59aa-4fe1-8c38-5a05de2c66e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:07 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Volume 50e8a8b9-1c29-4a51-987c-1b7f295415b4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4', 'volume_size': 2, 'snapshot_id': '7e47eeec-8bdd-4a48-a9e4-9b46356d49e8'} Sep 17 15:05:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 1G" returned: 0 in 0.703s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a25fcd-efea-40b4-b2c0-16629650c2ec -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:07 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a25fcd-efea-40b4-b2c0-16629650c2ec -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 Sep 17 15:05:07 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:08 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a25fcd-efea-40b4-b2c0-16629650c2ec -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623" returned: 0 in 0.412s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:08 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 is being set with open permissions: ugo+rw Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:08 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 Sep 17 15:05:08 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:08 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623" returned: 0 in 0.258s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:08 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.info Sep 17 15:05:08 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:08 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.info" returned: 0 in 0.265s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:08 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.info is being set with open permissions: ugo+rw Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:08 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.info Sep 17 15:05:08 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:08 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.info" returned: 0 in 0.251s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.475s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.248s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-quobyte-7e47eeec-8bdd-4a48-a9e4-9b46356d49e8-50e8a8b9-1c29-4a51-987c-1b7f295415b4" by "_create_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-7e47eeec-8bdd-4a48-a9e4-9b46356d49e8-50e8a8b9-1c29-4a51-987c-1b7f295415b4" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Creating volume 50e8a8b9-1c29-4a51-987c-1b7f295415b4 from snapshot 7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 {{(pid=86082) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:05:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-quobyte-50e8a8b9-1c29-4a51-987c-1b7f295415b4" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:09 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0bf90c11-cef6-4557-bddd-65918fc435e9 tempest-SnapshotsActionsTest-573001935 None] Create snapshot completed successfully Sep 17 15:05:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-50e8a8b9-1c29-4a51-987c-1b7f295415b4" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] snapshot: 7e47eeec-8bdd-4a48-a9e4-9b46356d49e8, volume: 50e8a8b9-1c29-4a51-987c-1b7f295415b4, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:05:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:09 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7526c699-2e68-4624-8a49-eeeff2787068]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:09 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 Sep 17 15:05:09 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:09 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8" returned: 0 in 0.540s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e257edd-87f1-4906-8333-a81300bfa922(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:09 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[674837f6-8fa4-4258-9847-fea6f0fc0629]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:09 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 Sep 17 15:05:09 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cedd9584-0e90-4813-b181-45499fd41c9f tempest-SnapshotsActionsTest-573001935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:10 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922" returned: 0 in 0.503s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:05:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:05:10 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Path /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4 not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:05:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:10 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4 Sep 17 15:05:10 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:10 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:05:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Flow 'volume_create_manager' (ba2ce2dd-c4f2-4167-adb8-190ce779e92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872f50f7-da41-4fb5-9b01-fa6b6f9a14e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (872f50f7-da41-4fb5-9b01-fa6b6f9a14e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1148114460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0bf22a-85c4-42e2-926b-9d8c3d380586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='675a768be4084a0c98a7d4249e2b26ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:11Z,use_quota=True,user_id='76200a7f36d24cf19a3138647f7e5ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94531e94-0bb1-4cf6-bd79-aa151c0cbd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94531e94-0bb1-4cf6-bd79-aa151c0cbd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a1bac2-d4f6-4e36-9b25-6263ed8d3480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:10 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:05:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a1bac2-d4f6-4e36-9b25-6263ed8d3480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3a0bf22a-85c4-42e2-926b-9d8c3d380586', 'volume_name': 'volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586', 'volume_size': 1, 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a89aff0fcdbc4ac4a1aadbcc303a1058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd928b357-d516-479a-9030-78a0e857cb53', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d928b357-d516-479a-9030-78a0e857cb53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af41e3e8-911c-492a-ab7d-9eea3e39ec19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af41e3e8-911c-492a-ab7d-9eea3e39ec19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (501c86bd-fba1-450c-a1f3-48418f08a422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:11 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Volume 3a0bf22a-85c4-42e2-926b-9d8c3d380586: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586', 'volume_size': 1, 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a89aff0fcdbc4ac4a1aadbcc303a1058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd928b357-d516-479a-9030-78a0e857cb53', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d928b357-d516-479a-9030-78a0e857cb53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 15:05:11 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Trying to clone 3a0bf22a-85c4-42e2-926b-9d8c3d380586 from image d928b357-d516-479a-9030-78a0e857cb53 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:05:12 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_kdbu5ogbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 15:05:12 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Image download 20.69 MB at 20.69 MB/s Sep 17 15:05:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6eae40-16ce-4ca0-ac32-2e30dfb44acd]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_kdbu5ogbdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:12 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_kdbu5ogbdevstack@QuobyteHD Sep 17 15:05:12 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:13 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_kdbu5ogbdevstack@QuobyteHD" returned: 0 in 0.961s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:13 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Temporary image d928b357-d516-479a-9030-78a0e857cb53 is fetched for user 76200a7f36d24cf19a3138647f7e5ab9. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 15:05:13 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc3b9fa-77c8-4882-95f1-fb74802533e3]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_kdbu5ogbdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:13 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_kdbu5ogbdevstack@QuobyteHD Sep 17 15:05:13 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:14 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_kdbu5ogbdevstack@QuobyteHD" returned: 0 in 0.713s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:19 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4" returned: 0 in 9.098s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:19 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Image conversion details: src /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922, size 1024.00 MB, duration 9.10 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:05:19 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Converted 1024.00 MB image at 112.54 MB/s Sep 17 15:05:19 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4 is being set with open permissions: ugo+rw Sep 17 15:05:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:19 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4 Sep 17 15:05:19 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:19 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4" returned: 0 in 0.255s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-50e8a8b9-1c29-4a51-987c-1b7f295415b4" released by "_copy_volume_from_snapshot" :: held 10.516s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-7e47eeec-8bdd-4a48-a9e4-9b46356d49e8-50e8a8b9-1c29-4a51-987c-1b7f295415b4" released by "_create_volume_from_snapshot" :: held 10.599s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.632s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cedd9584-0e90-4813-b181-45499fd41c9f tempest-SnapshotsActionsTest-573001935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.443s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-cedd9584-0e90-4813-b181-45499fd41c9f tempest-SnapshotsActionsTest-573001935 None] Creating offline snapshot b2f1e1ad-11f0-443b-9e66-f7b298b47d80 of volume 36a25fcd-efea-40b4-b2c0-16629650c2ec {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:05:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f7b64d-59aa-4fe1-8c38-5a05de2c66e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4', 'volume_size': 2, 'snapshot_id': '7e47eeec-8bdd-4a48-a9e4-9b46356d49e8'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca65c47f-39eb-4359-9314-c717e0c5bf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:19 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9ac4f1-9a67-4050-9456-f0defa1f78fb]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cedd9584-0e90-4813-b181-45499fd41c9f tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:19 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Volume volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4 (50e8a8b9-1c29-4a51-987c-1b7f295415b4): created successfully Sep 17 15:05:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca65c47f-39eb-4359-9314-c717e0c5bf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Flow 'volume_create_manager' (a834954a-0cb1-4a9b-8053-02b067a6b520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:19 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c32ffe93-2b8b-4f3c-9357-bf7c28109079 tempest-VolumesSnapshotTestJSON-1278407807 None] Created volume successfully. Sep 17 15:05:19 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 Sep 17 15:05:19 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-50e8a8b9-1c29-4a51-987c-1b7f295415b4-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:20 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cedd9584-0e90-4813-b181-45499fd41c9f tempest-SnapshotsActionsTest-573001935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623" returned: 0 in 0.406s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-cedd9584-0e90-4813-b181-45499fd41c9f tempest-SnapshotsActionsTest-573001935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a25fcd-efea-40b4-b2c0-16629650c2ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cedd9584-0e90-4813-b181-45499fd41c9f tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-50e8a8b9-1c29-4a51-987c-1b7f295415b4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:20 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80 1G Sep 17 15:05:20 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-quobyte-50e8a8b9-1c29-4a51-987c-1b7f295415b4" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-50e8a8b9-1c29-4a51-987c-1b7f295415b4" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:20 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[effbe952-c115-43c0-8fc2-8def90b9e645]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:20 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4 Sep 17 15:05:20 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:20 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cedd9584-0e90-4813-b181-45499fd41c9f tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80 1G" returned: 0 in 0.440s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cedd9584-0e90-4813-b181-45499fd41c9f tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:20 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80 Sep 17 15:05:20 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:20 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4" returned: 0 in 0.465s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:20 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4 Sep 17 15:05:20 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:20 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cedd9584-0e90-4813-b181-45499fd41c9f tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80" returned: 0 in 0.347s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:20 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-cedd9584-0e90-4813-b181-45499fd41c9f tempest-SnapshotsActionsTest-573001935 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80 is being set with open permissions: ugo+rw Sep 17 15:05:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cedd9584-0e90-4813-b181-45499fd41c9f tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:20 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80 Sep 17 15:05:20 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:20 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-50e8a8b9-1c29-4a51-987c-1b7f295415b4" returned: 0 in 0.320s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-50e8a8b9-1c29-4a51-987c-1b7f295415b4" released by "delete_volume" :: held 0.835s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] Created reservations ['49cd21c4-c6c6-4f72-9e85-b1741c2f40d8', '7c7c9be8-3407-4b42-921f-fd6103916738', 'ed6cb6f3-3fdf-40f7-bc06-1bf4cc02529b', '9b639032-666f-4682-9077-02be661cce61'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:21 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cedd9584-0e90-4813-b181-45499fd41c9f tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80" returned: 0 in 0.301s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:21 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:05:21 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cedd9584-0e90-4813-b181-45499fd41c9f tempest-SnapshotsActionsTest-573001935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.636s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.978s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1148114460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0bf22a-85c4-42e2-926b-9d8c3d380586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='675a768be4084a0c98a7d4249e2b26ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:11Z,use_quota=True,user_id='76200a7f36d24cf19a3138647f7e5ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Creating volume 3a0bf22a-85c4-42e2-926b-9d8c3d380586 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:05:21 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-cedd9584-0e90-4813-b181-45499fd41c9f tempest-SnapshotsActionsTest-573001935 None] Create snapshot completed successfully Sep 17 15:05:21 devstack sudo[97259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 1073741824 Sep 17 15:05:21 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-7e47eeec-8bdd-4a48-a9e4-9b46356d49e8-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-7e47eeec-8bdd-4a48-a9e4-9b46356d49e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-quobyte-0e257edd-87f1-4906-8333-a81300bfa922" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-0e257edd-87f1-4906-8333-a81300bfa922" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-quobyte-7e47eeec-8bdd-4a48-a9e4-9b46356d49e8" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-7e47eeec-8bdd-4a48-a9e4-9b46356d49e8" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] Deleting offline snapshot 7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 of volume 0e257edd-87f1-4906-8333-a81300bfa922 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:05:21 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] snapshot_file for this snap is: volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.304s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5865dd-427a-460b-a6ff-858e72415dd4]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] Deleted volume successfully. Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ee81d6e9-4f3f-4147-84a9-8b8f87c1f881 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-50e8a8b9-1c29-4a51-987c-1b7f295415b4-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:21 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 Sep 17 15:05:21 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:21 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 1073741824" returned: 0 in 0.561s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:21 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 Sep 17 15:05:21 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:21 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8" returned: 0 in 0.480s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e257edd-87f1-4906-8333-a81300bfa922(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa92a04-f158-4e5a-9bad-3ab79045054b]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] Acquiring lock "cinder-b2f1e1ad-11f0-443b-9e66-f7b298b47d80-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-b2f1e1ad-11f0-443b-9e66-f7b298b47d80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] Acquiring lock "cinder-quobyte-36a25fcd-efea-40b4-b2c0-16629650c2ec" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-quobyte-36a25fcd-efea-40b4-b2c0-16629650c2ec" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] Acquiring lock "cinder-quobyte-b2f1e1ad-11f0-443b-9e66-f7b298b47d80" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-quobyte-b2f1e1ad-11f0-443b-9e66-f7b298b47d80" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] Deleting offline snapshot b2f1e1ad-11f0-443b-9e66-f7b298b47d80 of volume 36a25fcd-efea-40b4-b2c0-16629650c2ec {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:05:22 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 Sep 17 15:05:22 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] snapshot_file for this snap is: volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:05:22 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586" returned: 0 in 0.361s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3f5b1c-346f-45a2-b7ae-7ab432e55d80]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Attempting download of d928b357-d516-479a-9030-78a0e857cb53 ((None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}])) to volume 3a0bf22a-85c4-42e2-926b-9d8c3d380586. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:05:22 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80 Sep 17 15:05:22 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0113971-68c0-4f06-bc8c-981e8b794564]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_dr3vy7v2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:22 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_dr3vy7v2 Sep 17 15:05:22 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:22 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80" returned: 0 in 0.423s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a25fcd-efea-40b4-b2c0-16629650c2ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[766c75aa-8ae1-461f-9f0a-d646ab0dcb09]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:22 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:22 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_dr3vy7v2" returned: 0 in 0.467s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922" returned: 0 in 0.806s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_dr3vy7v2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:22 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 Sep 17 15:05:22 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:22 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 Sep 17 15:05:22 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:22 devstack sudo[97290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_dr3vy7v2 Sep 17 15:05:22 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:23 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623" returned: 0 in 0.445s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a25fcd-efea-40b4-b2c0-16629650c2ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:23 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80 Sep 17 15:05:23 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:23 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_dr3vy7v2" returned: 1 in 0.404s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_dr3vy7v2' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[48883227-888a-43ab-9103-db54c33cd347]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_kdbu5ogbdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:23 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8" returned: 0 in 0.412s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:23 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8 Sep 17 15:05:23 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:23 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_kdbu5ogbdevstack@QuobyteHD Sep 17 15:05:23 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:23 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922.7e47eeec-8bdd-4a48-a9e4-9b46356d49e8" returned: 0 in 0.318s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:23 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80" returned: 0 in 0.468s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:23 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-7e47eeec-8bdd-4a48-a9e4-9b46356d49e8" released by "_delete_snapshot" :: held 2.185s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_kdbu5ogbdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] d928b357-d516-479a-9030-78a0e857cb53 was qcow2, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_kdbu5ogbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:23 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80 Sep 17 15:05:23 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-0e257edd-87f1-4906-8333-a81300bfa922" released by "delete_snapshot" :: held 2.250s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:23 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_kdbu5ogbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 Sep 17 15:05:23 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] Created reservations ['d17cbf90-bd73-4354-86da-26bede2880b1', 'faeae9e0-10f1-4638-b9aa-aa4f18ae5caa', '6fff4186-3538-4ad4-9f95-e9b4b8e01a0d', '0038b988-26ba-485d-9425-937d03d7f16a'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] Delete snapshot completed successfully. Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ad69ffb3-117f-4777-8516-82e0ba8b8b7e tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-7e47eeec-8bdd-4a48-a9e4-9b46356d49e8-delete_snapshot" released by "delete_snapshot" :: held 2.431s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:23 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.b2f1e1ad-11f0-443b-9e66-f7b298b47d80" returned: 0 in 0.306s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-quobyte-b2f1e1ad-11f0-443b-9e66-f7b298b47d80" released by "_delete_snapshot" :: held 1.784s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-quobyte-36a25fcd-efea-40b4-b2c0-16629650c2ec" released by "delete_snapshot" :: held 1.815s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:24 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] Created reservations ['4c38a7bf-6315-4787-8294-367c9ff2db91', '09458130-6d5c-45f9-9285-9c40253d09a9', 'd36e83ff-0900-42e7-8e52-284adf7b30c4', '1c7bfd92-cb87-4f46-b3f8-b156fba0066e'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:24 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] Delete snapshot completed successfully. Sep 17 15:05:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e6408d9d-a8e3-4ca6-bb1c-5a3a79cf92d7 tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-b2f1e1ad-11f0-443b-9e66-f7b298b47d80-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d924a76-5814-49e7-ad7d-592f44704ae3 tempest-SnapshotsActionsTest-573001935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d924a76-5814-49e7-ad7d-592f44704ae3 tempest-SnapshotsActionsTest-573001935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5d924a76-5814-49e7-ad7d-592f44704ae3 tempest-SnapshotsActionsTest-573001935 None] Creating offline snapshot 6e96e2e3-b34a-4f62-9696-707ed15a911f of volume 36a25fcd-efea-40b4-b2c0-16629650c2ec {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:05:24 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[397b3b79-4e0f-42b0-a4fb-46d29aec743f]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d924a76-5814-49e7-ad7d-592f44704ae3 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-0e257edd-87f1-4906-8333-a81300bfa922-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-0e257edd-87f1-4906-8333-a81300bfa922-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-quobyte-0e257edd-87f1-4906-8333-a81300bfa922" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-0e257edd-87f1-4906-8333-a81300bfa922" acquired by "delete_volume" :: waited 0.042s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:24 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 Sep 17 15:05:24 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:25 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba8cd2e-7661-491b-b321-58223a85ea0c]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:25 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 Sep 17 15:05:25 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:25 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d924a76-5814-49e7-ad7d-592f44704ae3 tempest-SnapshotsActionsTest-573001935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623" returned: 0 in 0.606s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5d924a76-5814-49e7-ad7d-592f44704ae3 tempest-SnapshotsActionsTest-573001935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a25fcd-efea-40b4-b2c0-16629650c2ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d924a76-5814-49e7-ad7d-592f44704ae3 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:25 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f 1G Sep 17 15:05:25 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:25 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922" returned: 0 in 0.450s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:25 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922 Sep 17 15:05:25 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:25 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0e257edd-87f1-4906-8333-a81300bfa922" returned: 0 in 0.333s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-0e257edd-87f1-4906-8333-a81300bfa922" released by "delete_volume" :: held 0.921s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:25 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] Created reservations ['02b58178-7c44-43b6-b185-492fba0fc0e6', '8b83a47d-d627-45d5-af17-b6b26e9a7320', 'aa7bfe44-0daf-4236-931d-8576e2cf76d1', 'b5466f88-e505-42b4-b8e0-92aef74934a5'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:25 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:25 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_kdbu5ogbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586" returned: 0 in 2.314s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:25 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_kdbu5ogbdevstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:05:25 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Converted 112.00 MB image at 48.35 MB/s Sep 17 15:05:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d924a76-5814-49e7-ad7d-592f44704ae3 tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f 1G" returned: 0 in 0.613s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d924a76-5814-49e7-ad7d-592f44704ae3 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:26 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 1G Sep 17 15:05:26 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:26 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f Sep 17 15:05:26 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:26 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:05:26 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:26 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d924a76-5814-49e7-ad7d-592f44704ae3 tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f" returned: 0 in 0.370s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:26 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-5d924a76-5814-49e7-ad7d-592f44704ae3 tempest-SnapshotsActionsTest-573001935 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f is being set with open permissions: ugo+rw Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d924a76-5814-49e7-ad7d-592f44704ae3 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:26 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f Sep 17 15:05:26 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:26 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 1G" returned: 0 in 0.456s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Downloaded image d928b357-d516-479a-9030-78a0e857cb53 ((None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}])) to volume 3a0bf22a-85c4-42e2-926b-9d8c3d380586 successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Temporary image d928b357-d516-479a-9030-78a0e857cb53 for user 76200a7f36d24cf19a3138647f7e5ab9 is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Marking volume 3a0bf22a-85c4-42e2-926b-9d8c3d380586 as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:05:26 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.318s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Copying metadata from image d928b357-d516-479a-9030-78a0e857cb53 to 3a0bf22a-85c4-42e2-926b-9d8c3d380586. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Creating volume glance metadata for volume 3a0bf22a-85c4-42e2-926b-9d8c3d380586 backed by image d928b357-d516-479a-9030-78a0e857cb53 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:05:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] Deleted volume successfully. Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ef84860e-28d2-44b5-8d06-99c3dadb0d37 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-0e257edd-87f1-4906-8333-a81300bfa922-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (501c86bd-fba1-450c-a1f3-48418f08a422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586', 'volume_size': 1, 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a89aff0fcdbc4ac4a1aadbcc303a1058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd928b357-d516-479a-9030-78a0e857cb53', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d928b357-d516-479a-9030-78a0e857cb53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d048a1-3ecf-4f8c-abb1-816b7771cce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:26 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Volume volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 (3a0bf22a-85c4-42e2-926b-9d8c3d380586): created successfully Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d048a1-3ecf-4f8c-abb1-816b7771cce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Flow 'volume_create_manager' (ba2ce2dd-c4f2-4167-adb8-190ce779e92c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-bdb681dc-62fc-4acf-b9c7-b180a27b0b05 tempest-VolumesExtendTest-117070916 None] Created volume successfully. Sep 17 15:05:26 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d924a76-5814-49e7-ad7d-592f44704ae3 tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f" returned: 0 in 0.293s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d924a76-5814-49e7-ad7d-592f44704ae3 tempest-SnapshotsActionsTest-573001935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.020s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5d924a76-5814-49e7-ad7d-592f44704ae3 tempest-SnapshotsActionsTest-573001935 None] Create snapshot completed successfully Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21ed6275-2b5c-43b3-886c-8027a18a21bb tempest-VolumesExtendTest-117070916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21ed6275-2b5c-43b3-886c-8027a18a21bb tempest-VolumesExtendTest-117070916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09ab0e0-f077-448a-87ab-35b9914a5460]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21ed6275-2b5c-43b3-886c-8027a18a21bb tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:27 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 Sep 17 15:05:27 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Flow 'volume_create_manager' (e230683f-f02b-436d-8fd4-cf4e8a7e08b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3daef917-2530-4ebf-b2f2-5aa46754149f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3daef917-2530-4ebf-b2f2-5aa46754149f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-708870336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc82543-3a89-445b-ae03-02071cb1a6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2750af9d9645d7b5fb328d2b1fd37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:28Z,use_quota=True,user_id='b77d4b9e12c14135a67fbf87bd364508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df490f2-42f8-4909-9753-d7d3b9514709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df490f2-42f8-4909-9753-d7d3b9514709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263d7699-d954-4298-8ab5-39f7a7a8b01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (263d7699-d954-4298-8ab5-39f7a7a8b01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fc82543-3a89-445b-ae03-02071cb1a6da', 'volume_name': 'volume-5fc82543-3a89-445b-ae03-02071cb1a6da', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30412dd-66c0-44bf-a97c-b24cf6d8bcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30412dd-66c0-44bf-a97c-b24cf6d8bcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce35ebf-a015-46ee-911b-5cabb4c87512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:27 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Volume 5fc82543-3a89-445b-ae03-02071cb1a6da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fc82543-3a89-445b-ae03-02071cb1a6da', 'volume_size': 1} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:27 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21ed6275-2b5c-43b3-886c-8027a18a21bb tempest-VolumesExtendTest-117070916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586" returned: 0 in 0.388s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21ed6275-2b5c-43b3-886c-8027a18a21bb tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 2G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21ed6275-2b5c-43b3-886c-8027a18a21bb tempest-VolumesExtendTest-117070916 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 2G" returned: 0 in 0.103s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21ed6275-2b5c-43b3-886c-8027a18a21bb tempest-VolumesExtendTest-117070916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.520s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.120s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-708870336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc82543-3a89-445b-ae03-02071cb1a6da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2750af9d9645d7b5fb328d2b1fd37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:28Z,use_quota=True,user_id='b77d4b9e12c14135a67fbf87bd364508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Creating volume 5fc82543-3a89-445b-ae03-02071cb1a6da {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:05:27 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:27 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da 1073741824 Sep 17 15:05:27 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] Acquiring lock "cinder-6e96e2e3-b34a-4f62-9696-707ed15a911f-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-21ed6275-2b5c-43b3-886c-8027a18a21bb tempest-VolumesExtendTest-117070916 None] Extend volume completed successfully. Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-6e96e2e3-b34a-4f62-9696-707ed15a911f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] Acquiring lock "cinder-quobyte-36a25fcd-efea-40b4-b2c0-16629650c2ec" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-quobyte-36a25fcd-efea-40b4-b2c0-16629650c2ec" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] Acquiring lock "cinder-quobyte-6e96e2e3-b34a-4f62-9696-707ed15a911f" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-quobyte-6e96e2e3-b34a-4f62-9696-707ed15a911f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] Deleting offline snapshot 6e96e2e3-b34a-4f62-9696-707ed15a911f of volume 36a25fcd-efea-40b4-b2c0-16629650c2ec {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] snapshot_file for this snap is: volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e62909a-de4b-4617-bb6c-777825234502]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:28 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f Sep 17 15:05:28 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:28 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da 1073741824" returned: 0 in 0.442s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:28 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da Sep 17 15:05:28 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:28 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f" returned: 0 in 0.385s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a25fcd-efea-40b4-b2c0-16629650c2ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c87c272-8aca-4b7d-b170-af43c860c612]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:28 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 Sep 17 15:05:28 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:28 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da" returned: 0 in 0.269s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce35ebf-a015-46ee-911b-5cabb4c87512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fc82543-3a89-445b-ae03-02071cb1a6da', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b8d69a-7312-4069-a311-b8c157423b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:28 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Volume volume-5fc82543-3a89-445b-ae03-02071cb1a6da (5fc82543-3a89-445b-ae03-02071cb1a6da): created successfully Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b8d69a-7312-4069-a311-b8c157423b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Flow 'volume_create_manager' (e230683f-f02b-436d-8fd4-cf4e8a7e08b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-84aacff7-155e-4d8d-aaa7-c9787d992b19 tempest-VolumesSnapshotTestJSON-1278407807 None] Created volume successfully. Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] Acquiring lock "cinder-3a0bf22a-85c4-42e2-926b-9d8c3d380586-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] Lock "cinder-3a0bf22a-85c4-42e2-926b-9d8c3d380586-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] Acquiring lock "cinder-quobyte-3a0bf22a-85c4-42e2-926b-9d8c3d380586" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] Lock "cinder-quobyte-3a0bf22a-85c4-42e2-926b-9d8c3d380586" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0a202a-4a76-43dd-9836-74d3b5d97c46]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:28 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623" returned: 0 in 0.427s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a25fcd-efea-40b4-b2c0-16629650c2ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:28 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f Sep 17 15:05:28 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:28 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 Sep 17 15:05:28 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:29 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586" returned: 0 in 0.364s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:29 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586 Sep 17 15:05:29 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:29 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f" returned: 0 in 0.415s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:29 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f Sep 17 15:05:29 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:29 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a0bf22a-85c4-42e2-926b-9d8c3d380586" returned: 0 in 0.259s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] Lock "cinder-quobyte-3a0bf22a-85c4-42e2-926b-9d8c3d380586" released by "delete_volume" :: held 0.671s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] Created reservations ['64109965-66f7-4c44-8160-2638e6e69b45', 'c8e67622-22e4-4e55-b5ab-acdaf46b31a2', 'c6bad90f-ee6f-4ba5-8190-c344cf68829e', 'ccda2dfb-d176-4045-926e-94bf032d37c6'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:29 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.6e96e2e3-b34a-4f62-9696-707ed15a911f" returned: 0 in 0.257s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-quobyte-6e96e2e3-b34a-4f62-9696-707ed15a911f" released by "_delete_snapshot" :: held 1.595s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-quobyte-36a25fcd-efea-40b4-b2c0-16629650c2ec" released by "delete_snapshot" :: held 1.624s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:29 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:05:29 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] Created reservations ['67c9c63c-bfc2-43f1-b0d3-f3e9bae042e8', 'aae7c71b-fba7-492f-9979-01205ae54e0c', 'ba8c3cfc-4058-4246-bdcb-8fb61917bf6e', '1c1b4a48-a9d4-49de-b96b-2e5bdb21efae'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] Delete snapshot completed successfully. Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f15759b2-ea5e-449a-93c2-c6d1a729e624 tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-6e96e2e3-b34a-4f62-9696-707ed15a911f-delete_snapshot" released by "delete_snapshot" :: held 1.813s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:29 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.316s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] Deleted volume successfully. Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] Creating offline snapshot 16f6b4be-6831-4c18-b43d-5db57716b9e1 of volume 5fc82543-3a89-445b-ae03-02071cb1a6da {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7f13b709-73f5-452a-b604-949d2c047d74 tempest-VolumesExtendTest-117070916 None] Lock "cinder-3a0bf22a-85c4-42e2-926b-9d8c3d380586-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d523444-519c-485f-bb95-a371ad1719e2]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:30 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da Sep 17 15:05:30 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:30 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da" returned: 0 in 0.459s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:05:30 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1 1G Sep 17 15:05:30 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Flow 'volume_create_manager' (bd6a1f10-73a6-4715-97ff-8ca6b6b862d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc94b83-efba-4f20-b555-92b398b6381c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc94b83-efba-4f20-b555-92b398b6381c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-701738466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2817cc3e-6d6a-473a-a509-c7dfc31d6512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='675a768be4084a0c98a7d4249e2b26ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:30Z,use_quota=True,user_id='76200a7f36d24cf19a3138647f7e5ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636ba818-8e1b-4a0c-a0f0-bab7c9bf5992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636ba818-8e1b-4a0c-a0f0-bab7c9bf5992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f55023-b467-4036-83d7-fc29742df058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f55023-b467-4036-83d7-fc29742df058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2817cc3e-6d6a-473a-a509-c7dfc31d6512', 'volume_name': 'volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c25bf11-1640-402c-b784-6a8c35cda373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c25bf11-1640-402c-b784-6a8c35cda373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097b087f-ffc8-4920-9c83-8e02cc5e2f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:30 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Volume 2817cc3e-6d6a-473a-a509-c7dfc31d6512: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512', 'volume_size': 1} Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-623c574e-f5f1-4311-ac38-fffb56366a4c tempest-SnapshotsActionsTest-573001935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:30 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1 1G" returned: 0 in 0.407s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fc82543-3a89-445b-ae03-02071cb1a6da -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:30 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fc82543-3a89-445b-ae03-02071cb1a6da -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1 Sep 17 15:05:30 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:31 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fc82543-3a89-445b-ae03-02071cb1a6da -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1" returned: 0 in 0.291s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:31 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1 is being set with open permissions: ugo+rw Sep 17 15:05:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:31 devstack sudo[97437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1 Sep 17 15:05:31 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:31 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1" returned: 0 in 0.246s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:31 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.info Sep 17 15:05:31 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:31 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.info" returned: 0 in 0.249s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:31 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.info is being set with open permissions: ugo+rw Sep 17 15:05:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:31 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.info Sep 17 15:05:31 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:31 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.info" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.017s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.405s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-701738466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2817cc3e-6d6a-473a-a509-c7dfc31d6512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='675a768be4084a0c98a7d4249e2b26ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:30Z,use_quota=True,user_id='76200a7f36d24cf19a3138647f7e5ab9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:05:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Creating volume 2817cc3e-6d6a-473a-a509-c7dfc31d6512 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:05:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:05:31 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:05:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:32 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 1073741824 Sep 17 15:05:32 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:32 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9bf70a06-ecd7-4de5-8746-ba73eb216cce tempest-VolumesSnapshotTestJSON-1278407807 None] Create snapshot completed successfully Sep 17 15:05:32 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 1073741824" returned: 0 in 0.462s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:32 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 Sep 17 15:05:32 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:32 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512" returned: 0 in 0.258s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:05:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-623c574e-f5f1-4311-ac38-fffb56366a4c tempest-SnapshotsActionsTest-573001935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.161s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097b087f-ffc8-4920-9c83-8e02cc5e2f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61cc21a-1074-4e6a-8ad3-0cc6b29ff550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-623c574e-f5f1-4311-ac38-fffb56366a4c tempest-SnapshotsActionsTest-573001935 None] Creating offline snapshot 336d3b6f-6211-4403-9b90-74b214bb7518 of volume 36a25fcd-efea-40b4-b2c0-16629650c2ec {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:05:32 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Volume volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 (2817cc3e-6d6a-473a-a509-c7dfc31d6512): created successfully Sep 17 15:05:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61cc21a-1074-4e6a-8ad3-0cc6b29ff550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Flow 'volume_create_manager' (bd6a1f10-73a6-4715-97ff-8ca6b6b862d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:32 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[88581a11-4932-433e-9c2d-0802045ec6d3]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-623c574e-f5f1-4311-ac38-fffb56366a4c tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:32 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b0b2771d-dab7-4694-837e-dd4ea283b76e tempest-VolumesExtendTest-117070916 None] Created volume successfully. Sep 17 15:05:32 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 Sep 17 15:05:32 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:33 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-623c574e-f5f1-4311-ac38-fffb56366a4c tempest-SnapshotsActionsTest-573001935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623" returned: 0 in 0.404s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-623c574e-f5f1-4311-ac38-fffb56366a4c tempest-SnapshotsActionsTest-573001935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a25fcd-efea-40b4-b2c0-16629650c2ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-623c574e-f5f1-4311-ac38-fffb56366a4c tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:33 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518 1G Sep 17 15:05:33 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:33 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:05:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Flow 'volume_create_manager' (e17cbc3f-d9bb-406f-8759-b36b2ea1769f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3889408-a390-483b-95d2-79f913d928ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3889408-a390-483b-95d2-79f913d928ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-371975394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ccc96cf-33ef-48d0-8057-f97e3b25f28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee2750af9d9645d7b5fb328d2b1fd37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=16f6b4be-6831-4c18-b43d-5db57716b9e1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:34Z,use_quota=True,user_id='b77d4b9e12c14135a67fbf87bd364508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2895ed27-d927-4b4b-b20b-986899947f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2895ed27-d927-4b4b-b20b-986899947f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e083d42-eb66-47ba-be76-4442a90f1b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e083d42-eb66-47ba-be76-4442a90f1b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2ccc96cf-33ef-48d0-8057-f97e3b25f28f', 'volume_name': 'volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f', 'volume_size': 1, 'snapshot_id': '16f6b4be-6831-4c18-b43d-5db57716b9e1'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3252def6-bf26-4a17-afe8-13c3520e84a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3252def6-bf26-4a17-afe8-13c3520e84a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907b1eb2-6b84-4680-8173-0c517193e09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:33 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Volume 2ccc96cf-33ef-48d0-8057-f97e3b25f28f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f', 'volume_size': 1, 'snapshot_id': '16f6b4be-6831-4c18-b43d-5db57716b9e1'} Sep 17 15:05:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:33 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-623c574e-f5f1-4311-ac38-fffb56366a4c tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518 1G" returned: 0 in 0.588s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-623c574e-f5f1-4311-ac38-fffb56366a4c tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:33 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518 Sep 17 15:05:33 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:34 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-623c574e-f5f1-4311-ac38-fffb56366a4c tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518" returned: 0 in 0.301s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:34 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-623c574e-f5f1-4311-ac38-fffb56366a4c tempest-SnapshotsActionsTest-573001935 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518 is being set with open permissions: ugo+rw Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-623c574e-f5f1-4311-ac38-fffb56366a4c tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:34 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518 Sep 17 15:05:34 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:34 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-623c574e-f5f1-4311-ac38-fffb56366a4c tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518" returned: 0 in 0.259s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-623c574e-f5f1-4311-ac38-fffb56366a4c tempest-SnapshotsActionsTest-573001935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.687s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.612s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-quobyte-16f6b4be-6831-4c18-b43d-5db57716b9e1-2ccc96cf-33ef-48d0-8057-f97e3b25f28f" by "_create_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-16f6b4be-6831-4c18-b43d-5db57716b9e1-2ccc96cf-33ef-48d0-8057-f97e3b25f28f" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Creating volume 2ccc96cf-33ef-48d0-8057-f97e3b25f28f from snapshot 16f6b4be-6831-4c18-b43d-5db57716b9e1 {{(pid=86082) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-quobyte-2ccc96cf-33ef-48d0-8057-f97e3b25f28f" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:34 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-623c574e-f5f1-4311-ac38-fffb56366a4c tempest-SnapshotsActionsTest-573001935 None] Create snapshot completed successfully Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-2ccc96cf-33ef-48d0-8057-f97e3b25f28f" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] snapshot: 16f6b4be-6831-4c18-b43d-5db57716b9e1, volume: 2ccc96cf-33ef-48d0-8057-f97e3b25f28f, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff932e21-1d77-485b-a8f9-d6f9ff4b3311]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:34 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1 Sep 17 15:05:34 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] Acquiring lock "cinder-336d3b6f-6211-4403-9b90-74b214bb7518-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-336d3b6f-6211-4403-9b90-74b214bb7518-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] Acquiring lock "cinder-quobyte-36a25fcd-efea-40b4-b2c0-16629650c2ec" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-quobyte-36a25fcd-efea-40b4-b2c0-16629650c2ec" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] Acquiring lock "cinder-quobyte-336d3b6f-6211-4403-9b90-74b214bb7518" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-quobyte-336d3b6f-6211-4403-9b90-74b214bb7518" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] Deleting offline snapshot 336d3b6f-6211-4403-9b90-74b214bb7518 of volume 36a25fcd-efea-40b4-b2c0-16629650c2ec {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] snapshot_file for this snap is: volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8df1c7-ed78-40da-9880-bed259bb9b0f]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:35 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1" returned: 0 in 0.437s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fc82543-3a89-445b-ae03-02071cb1a6da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:35 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d8c77a-caef-4212-b9d8-93be9075d6ca]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:35 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518 Sep 17 15:05:35 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:35 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da Sep 17 15:05:35 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:35 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518" returned: 0 in 0.396s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a25fcd-efea-40b4-b2c0-16629650c2ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:35 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed355ee2-d886-44be-b028-db5f6c956c00]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:35 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da" returned: 0 in 0.392s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:05:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:05:35 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Path /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:05:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:35 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f Sep 17 15:05:35 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:35 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 Sep 17 15:05:35 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:35 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623" returned: 0 in 0.384s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a25fcd-efea-40b4-b2c0-16629650c2ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:35 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518 Sep 17 15:05:35 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:36 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518" returned: 0 in 0.782s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:36 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518 Sep 17 15:05:36 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:37 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.336d3b6f-6211-4403-9b90-74b214bb7518" returned: 0 in 0.701s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-quobyte-336d3b6f-6211-4403-9b90-74b214bb7518" released by "_delete_snapshot" :: held 2.456s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-quobyte-36a25fcd-efea-40b4-b2c0-16629650c2ec" released by "delete_snapshot" :: held 2.496s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:37 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] Created reservations ['b1fd71b5-50ed-4ad9-9d99-af6372fa439a', 'bea6a1f9-fe19-41d0-9c0e-d7563a93c907', '548af3c5-de23-4936-b8e0-e0a137ec1df2', 'ccf01d88-8aca-40b6-a98d-2ac9d26e6a1a'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] Delete snapshot completed successfully. Sep 17 15:05:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-230aeed2-4a28-4e6e-9e91-41a37af1860a tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-336d3b6f-6211-4403-9b90-74b214bb7518-delete_snapshot" released by "delete_snapshot" :: held 2.943s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7887d69a-8cc4-443e-ac32-42cafde82303 tempest-SnapshotsActionsTest-573001935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:05:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:40 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:05:40 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:40 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.547s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:05:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:05:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:05:43 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f" returned: 0 in 7.961s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:43 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Image conversion details: src /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da, size 1024.00 MB, duration 7.96 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:05:43 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Converted 1024.00 MB image at 128.62 MB/s Sep 17 15:05:43 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f is being set with open permissions: ugo+rw Sep 17 15:05:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:43 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f Sep 17 15:05:43 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:43 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f" returned: 0 in 0.247s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-2ccc96cf-33ef-48d0-8057-f97e3b25f28f" released by "_copy_volume_from_snapshot" :: held 9.165s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-16f6b4be-6831-4c18-b43d-5db57716b9e1-2ccc96cf-33ef-48d0-8057-f97e3b25f28f" released by "_create_volume_from_snapshot" :: held 9.249s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.275s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.879s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] Creating offline snapshot 8a672813-2ec1-4f1f-b817-fa9fb444f998 of volume 2817cc3e-6d6a-473a-a509-c7dfc31d6512 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:05:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907b1eb2-6b84-4680-8173-0c517193e09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f', 'volume_size': 1, 'snapshot_id': '16f6b4be-6831-4c18-b43d-5db57716b9e1'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b0201b-79f7-410c-8868-aa894aa130cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[392557e1-3fad-4cd2-8b83-4353060d12bc]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:43 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Volume volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f (2ccc96cf-33ef-48d0-8057-f97e3b25f28f): created successfully Sep 17 15:05:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b0201b-79f7-410c-8868-aa894aa130cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Flow 'volume_create_manager' (e17cbc3f-d9bb-406f-8759-b36b2ea1769f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:43 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8a9c328a-7ee3-4ee7-9335-d6d89e0fa860 tempest-VolumesSnapshotTestJSON-1278407807 None] Created volume successfully. Sep 17 15:05:43 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 Sep 17 15:05:43 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:44 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512" returned: 0 in 0.378s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:44 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998 1G Sep 17 15:05:44 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:44 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998 1G" returned: 0 in 0.433s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:44 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998 Sep 17 15:05:44 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-2ccc96cf-33ef-48d0-8057-f97e3b25f28f-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:44 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998" returned: 0 in 0.320s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:44 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998 is being set with open permissions: ugo+rw Sep 17 15:05:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-2ccc96cf-33ef-48d0-8057-f97e3b25f28f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:44 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998 Sep 17 15:05:44 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-quobyte-2ccc96cf-33ef-48d0-8057-f97e3b25f28f" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-2ccc96cf-33ef-48d0-8057-f97e3b25f28f" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:45 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b609c7f5-7bb0-4f78-8990-c5f0145b43cf]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:45 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f Sep 17 15:05:45 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:45 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998" returned: 0 in 0.276s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:45 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.info Sep 17 15:05:45 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:45 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f" returned: 0 in 0.409s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:45 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f Sep 17 15:05:45 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:45 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.info" returned: 0 in 0.281s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:45 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.info is being set with open permissions: ugo+rw Sep 17 15:05:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:45 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.info Sep 17 15:05:45 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:45 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2ccc96cf-33ef-48d0-8057-f97e3b25f28f" returned: 0 in 0.282s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-2ccc96cf-33ef-48d0-8057-f97e3b25f28f" released by "delete_volume" :: held 0.741s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:45 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.info" returned: 0 in 0.289s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.088s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7887d69a-8cc4-443e-ac32-42cafde82303 tempest-SnapshotsActionsTest-573001935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.918s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7887d69a-8cc4-443e-ac32-42cafde82303 tempest-SnapshotsActionsTest-573001935 None] Creating offline snapshot 07b616b1-93b1-4678-9402-5b959ad1637b of volume 36a25fcd-efea-40b4-b2c0-16629650c2ec {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:05:45 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] Created reservations ['7818af02-c7b9-4831-a850-4846ac8f2db1', 'f51a0f11-0508-456e-8e52-d6c090a9425c', 'eba8eed5-929b-42f8-b96b-5124b4db21a2', '2f34dad5-5c84-46e3-ba3d-5a81ec5daf1e'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b3e3c5a6-4161-4377-997f-11c32ac98029 tempest-VolumesExtendTest-117070916 None] Create snapshot completed successfully Sep 17 15:05:45 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8c59be-60d4-492b-a7ae-b4a908571059]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7887d69a-8cc4-443e-ac32-42cafde82303 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:46 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 Sep 17 15:05:46 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:46 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:05:46 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-16f6b4be-6831-4c18-b43d-5db57716b9e1-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-16f6b4be-6831-4c18-b43d-5db57716b9e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-quobyte-5fc82543-3a89-445b-ae03-02071cb1a6da" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-5fc82543-3a89-445b-ae03-02071cb1a6da" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-quobyte-16f6b4be-6831-4c18-b43d-5db57716b9e1" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-16f6b4be-6831-4c18-b43d-5db57716b9e1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] Deleting offline snapshot 16f6b4be-6831-4c18-b43d-5db57716b9e1 of volume 5fc82543-3a89-445b-ae03-02071cb1a6da {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] snapshot_file for this snap is: volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8da5c8c-5669-4285-9a2f-6bfe0a250a17]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:46 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:46 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.310s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7887d69a-8cc4-443e-ac32-42cafde82303 tempest-SnapshotsActionsTest-573001935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623" returned: 0 in 0.429s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7887d69a-8cc4-443e-ac32-42cafde82303 tempest-SnapshotsActionsTest-573001935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a25fcd-efea-40b4-b2c0-16629650c2ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7887d69a-8cc4-443e-ac32-42cafde82303 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] Deleted volume successfully. Sep 17 15:05:46 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b 1G Sep 17 15:05:46 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-948678eb-6e15-4e09-a9e1-328a208e0217 tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-2ccc96cf-33ef-48d0-8057-f97e3b25f28f-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:46 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1 Sep 17 15:05:46 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f009f8cf-e4b6-40ab-963a-73f326c43e60 tempest-VolumesExtendTest-117070916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:46 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1" returned: 0 in 0.476s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fc82543-3a89-445b-ae03-02071cb1a6da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a882756b-0e60-4f3c-a09f-2cb5f8e4fd5c]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:46 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da Sep 17 15:05:46 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:46 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7887d69a-8cc4-443e-ac32-42cafde82303 tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b 1G" returned: 0 in 0.635s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7887d69a-8cc4-443e-ac32-42cafde82303 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:47 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b Sep 17 15:05:47 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:47 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7887d69a-8cc4-443e-ac32-42cafde82303 tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b" returned: 0 in 0.356s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:47 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-7887d69a-8cc4-443e-ac32-42cafde82303 tempest-SnapshotsActionsTest-573001935 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b is being set with open permissions: ugo+rw Sep 17 15:05:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7887d69a-8cc4-443e-ac32-42cafde82303 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:47 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b Sep 17 15:05:47 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:47 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da" returned: 0 in 0.602s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:47 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1 Sep 17 15:05:47 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:47 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7887d69a-8cc4-443e-ac32-42cafde82303 tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b" returned: 0 in 0.290s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7887d69a-8cc4-443e-ac32-42cafde82303 tempest-SnapshotsActionsTest-573001935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.861s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f009f8cf-e4b6-40ab-963a-73f326c43e60 tempest-VolumesExtendTest-117070916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.928s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:47 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4ccaa8-5b44-437f-8c9f-6863669979d4]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f009f8cf-e4b6-40ab-963a-73f326c43e60 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:47 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7887d69a-8cc4-443e-ac32-42cafde82303 tempest-SnapshotsActionsTest-573001935 None] Create snapshot completed successfully Sep 17 15:05:47 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 Sep 17 15:05:47 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:47 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1" returned: 0 in 0.433s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:47 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1 Sep 17 15:05:47 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:48 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f009f8cf-e4b6-40ab-963a-73f326c43e60 tempest-VolumesExtendTest-117070916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512" returned: 0 in 0.536s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:48 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f009f8cf-e4b6-40ab-963a-73f326c43e60 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998 2G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da.16f6b4be-6831-4c18-b43d-5db57716b9e1" returned: 0 in 0.436s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-16f6b4be-6831-4c18-b43d-5db57716b9e1" released by "_delete_snapshot" :: held 2.129s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-5fc82543-3a89-445b-ae03-02071cb1a6da" released by "delete_snapshot" :: held 2.162s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f009f8cf-e4b6-40ab-963a-73f326c43e60 tempest-VolumesExtendTest-117070916 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998 2G" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f009f8cf-e4b6-40ab-963a-73f326c43e60 tempest-VolumesExtendTest-117070916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.842s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] Created reservations ['f38999ad-d3a4-4225-80e7-498bacb47492', '1d8f8d0f-d0c0-4665-ba4c-e7623412f11c', '22896b1d-7bfd-4faa-bf93-8d053edda013', 'fd82a63d-23da-4d81-b662-8b8c6e28e40c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] Acquiring lock "cinder-07b616b1-93b1-4678-9402-5b959ad1637b-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:48 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f009f8cf-e4b6-40ab-963a-73f326c43e60 tempest-VolumesExtendTest-117070916 None] Extend volume completed successfully. Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-07b616b1-93b1-4678-9402-5b959ad1637b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] Acquiring lock "cinder-quobyte-36a25fcd-efea-40b4-b2c0-16629650c2ec" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-quobyte-36a25fcd-efea-40b4-b2c0-16629650c2ec" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] Acquiring lock "cinder-quobyte-07b616b1-93b1-4678-9402-5b959ad1637b" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:48 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] Delete snapshot completed successfully. Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-quobyte-07b616b1-93b1-4678-9402-5b959ad1637b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] Deleting offline snapshot 07b616b1-93b1-4678-9402-5b959ad1637b of volume 36a25fcd-efea-40b4-b2c0-16629650c2ec {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] snapshot_file for this snap is: volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-02896313-1f1f-4bb5-add9-f67d33676adb tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-16f6b4be-6831-4c18-b43d-5db57716b9e1-delete_snapshot" released by "delete_snapshot" :: held 2.488s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9a9329-74d8-4e00-9862-daaa5f2929d2]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:48 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b Sep 17 15:05:48 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] Acquiring lock "cinder-8a672813-2ec1-4f1f-b817-fa9fb444f998-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:49 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b" returned: 0 in 0.430s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a25fcd-efea-40b4-b2c0-16629650c2ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] Lock "cinder-8a672813-2ec1-4f1f-b817-fa9fb444f998-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] Acquiring lock "cinder-quobyte-2817cc3e-6d6a-473a-a509-c7dfc31d6512" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f74695c-c1ef-41e3-a190-ece36679d8f3]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] Lock "cinder-quobyte-2817cc3e-6d6a-473a-a509-c7dfc31d6512" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] Acquiring lock "cinder-quobyte-8a672813-2ec1-4f1f-b817-fa9fb444f998" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] Lock "cinder-quobyte-8a672813-2ec1-4f1f-b817-fa9fb444f998" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] Deleting offline snapshot 8a672813-2ec1-4f1f-b817-fa9fb444f998 of volume 2817cc3e-6d6a-473a-a509-c7dfc31d6512 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] snapshot_file for this snap is: volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[84818355-f6e8-4294-81cf-4ae8a952e87e]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:49 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 Sep 17 15:05:49 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:49 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998 Sep 17 15:05:49 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-5fc82543-3a89-445b-ae03-02071cb1a6da-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-5fc82543-3a89-445b-ae03-02071cb1a6da-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-quobyte-5fc82543-3a89-445b-ae03-02071cb1a6da" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-5fc82543-3a89-445b-ae03-02071cb1a6da" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[35518cdc-57e6-40b6-bd7e-08cf358fc30d]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:49 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623" returned: 0 in 0.589s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a25fcd-efea-40b4-b2c0-16629650c2ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:49 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b Sep 17 15:05:49 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:49 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998" returned: 0 in 0.546s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:49 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da Sep 17 15:05:49 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc66f93-bece-4916-bca1-6cf0879af667]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:50 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 Sep 17 15:05:50 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:50 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b" returned: 0 in 0.440s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:50 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da" returned: 0 in 0.498s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:50 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b Sep 17 15:05:50 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:50 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da Sep 17 15:05:50 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:50 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512" returned: 0 in 0.486s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:50 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998 Sep 17 15:05:50 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:50 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.07b616b1-93b1-4678-9402-5b959ad1637b" returned: 0 in 0.311s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-quobyte-07b616b1-93b1-4678-9402-5b959ad1637b" released by "_delete_snapshot" :: held 1.944s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:50 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5fc82543-3a89-445b-ae03-02071cb1a6da" returned: 0 in 0.357s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-quobyte-36a25fcd-efea-40b4-b2c0-16629650c2ec" released by "delete_snapshot" :: held 1.989s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-5fc82543-3a89-445b-ae03-02071cb1a6da" released by "delete_volume" :: held 0.935s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] Created reservations ['4002206b-03c2-4654-9296-e0d8a2fb0685', '4a475d85-3675-4790-ad45-9eab7968821a', '7deef973-6d66-4a11-bc51-877aeedf53fd', '0c845a92-965e-482f-8d6a-8c5bba189f1b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] Created reservations ['e68a5c00-25f2-4c70-b38a-a2e6ab0afe7d', '0d29a564-5df6-4d80-af47-0ada17246066', '4ad9e62d-f59f-47cc-8520-74d672113412', '9aac018a-a4e2-45f1-b923-a63dbb73030d'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] Delete snapshot completed successfully. Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-77bda417-6de3-4776-be1e-3c0b2b66a35b tempest-SnapshotsActionsTest-774024189 None] Lock "cinder-07b616b1-93b1-4678-9402-5b959ad1637b-delete_snapshot" released by "delete_snapshot" :: held 2.274s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:50 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:05:50 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:50 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998" returned: 0 in 0.575s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:51 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998 Sep 17 15:05:51 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:51 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.278s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:51 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] Deleted volume successfully. Sep 17 15:05:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9f6f46e-f690-4ffb-9c68-a193db3999da tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-5fc82543-3a89-445b-ae03-02071cb1a6da-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:51 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512.8a672813-2ec1-4f1f-b817-fa9fb444f998" returned: 0 in 0.276s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] Lock "cinder-quobyte-8a672813-2ec1-4f1f-b817-fa9fb444f998" released by "_delete_snapshot" :: held 2.050s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] Lock "cinder-quobyte-2817cc3e-6d6a-473a-a509-c7dfc31d6512" released by "delete_snapshot" :: held 2.090s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:51 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] Created reservations ['8e86c6f4-58bc-44f3-8811-548935475b52', 'e554eb79-75f7-40b7-ad9f-204eaa6b5057', '27dc8c9a-e80f-42cc-a200-1de7638cff0f', '3101d4bd-f606-4bbd-87f4-1bbb457eeffb'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] Delete snapshot completed successfully. Sep 17 15:05:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb452c98-37be-4a46-9d0d-bf6a1cd28c1c tempest-VolumesExtendTest-117070916 None] Lock "cinder-8a672813-2ec1-4f1f-b817-fa9fb444f998-delete_snapshot" released by "delete_snapshot" :: held 2.269s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-936803c9-2846-4687-9f1c-e0bfad9b66d9-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-936803c9-2846-4687-9f1c-e0bfad9b66d9-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "cinder-quobyte-936803c9-2846-4687-9f1c-e0bfad9b66d9" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-936803c9-2846-4687-9f1c-e0bfad9b66d9" acquired by "delete_volume" :: waited 0.069s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:52 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[80aee867-93f6-4031-86ae-95efe81ec68d]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] Acquiring lock "cinder-2817cc3e-6d6a-473a-a509-c7dfc31d6512-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] Lock "cinder-2817cc3e-6d6a-473a-a509-c7dfc31d6512-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:52 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9 Sep 17 15:05:52 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] Acquiring lock "cinder-quobyte-2817cc3e-6d6a-473a-a509-c7dfc31d6512" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] Lock "cinder-quobyte-2817cc3e-6d6a-473a-a509-c7dfc31d6512" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] Acquiring lock "cinder-f84cb9a8-1655-46a5-8557-b78c2434a623-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e132234-50ff-4aa5-9080-ad88a88a59ae]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] Lock "cinder-f84cb9a8-1655-46a5-8557-b78c2434a623-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] Acquiring lock "cinder-quobyte-36a25fcd-efea-40b4-b2c0-16629650c2ec" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] Lock "cinder-quobyte-36a25fcd-efea-40b4-b2c0-16629650c2ec" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] Acquiring lock "cinder-quobyte-f84cb9a8-1655-46a5-8557-b78c2434a623" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] Lock "cinder-quobyte-f84cb9a8-1655-46a5-8557-b78c2434a623" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] Deleting offline snapshot f84cb9a8-1655-46a5-8557-b78c2434a623 of volume 36a25fcd-efea-40b4-b2c0-16629650c2ec {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] snapshot_file for this snap is: volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1132648b-dcc2-4b2e-a8db-5b66bf865861]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:53 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 Sep 17 15:05:53 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:53 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 Sep 17 15:05:53 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:53 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9" returned: 0 in 0.860s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:53 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9 Sep 17 15:05:53 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:53 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512" returned: 0 in 0.738s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:53 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512 Sep 17 15:05:53 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:53 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623" returned: 0 in 0.748s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a25fcd-efea-40b4-b2c0-16629650c2ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:53 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-936803c9-2846-4687-9f1c-e0bfad9b66d9" returned: 0 in 0.502s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad2e4e4-ed3b-4a84-8675-5ce29a854ed6]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-quobyte-936803c9-2846-4687-9f1c-e0bfad9b66d9" released by "delete_volume" :: held 1.594s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] Created reservations ['94210fc0-681a-4fd9-b4f0-684cd8e2bd30', '309f081a-14c5-4519-8146-98567551a0cd', 'b68b9a12-4060-4ce6-8bf3-4fb9dd343608', '4ef60cb0-8bac-4529-8897-03927e39c081'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:54 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec Sep 17 15:05:54 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:54 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2817cc3e-6d6a-473a-a509-c7dfc31d6512" returned: 0 in 0.448s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] Lock "cinder-quobyte-2817cc3e-6d6a-473a-a509-c7dfc31d6512" released by "delete_volume" :: held 1.334s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] Created reservations ['da817bcb-4da0-435e-b3c9-0b34284af049', '5a29d99b-d860-43a1-b4c2-1ae4cad12096', 'dbfff4f7-770c-47c2-99e5-51e3617ae50b', 'b90e648a-d467-4cfd-9e61-5afd85274b8b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:54 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:05:54 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:54 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:05:54 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:54 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec" returned: 0 in 0.560s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:54 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 Sep 17 15:05:54 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:54 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.450s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:54 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] Deleted volume successfully. Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-190d35a5-47a4-4780-810d-5b605687877a tempest-VolumesSnapshotTestJSON-1278407807 None] Lock "cinder-936803c9-2846-4687-9f1c-e0bfad9b66d9-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:54 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.403s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:54 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] Deleted volume successfully. Sep 17 15:05:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aeed96ed-ec2f-4674-a659-df2bafe086c7 tempest-VolumesExtendTest-117070916 None] Lock "cinder-2817cc3e-6d6a-473a-a509-c7dfc31d6512-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:55 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623" returned: 0 in 0.544s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:55 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623 Sep 17 15:05:55 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:55 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec.f84cb9a8-1655-46a5-8557-b78c2434a623" returned: 0 in 0.480s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] Lock "cinder-quobyte-f84cb9a8-1655-46a5-8557-b78c2434a623" released by "_delete_snapshot" :: held 2.589s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] Lock "cinder-quobyte-36a25fcd-efea-40b4-b2c0-16629650c2ec" released by "delete_snapshot" :: held 2.625s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:55 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] Created reservations ['c3ce0d19-f963-46a9-837d-231a3775ece4', 'fbe872c6-b795-43d8-ae70-236f7c9e52e5', '840da724-3f76-47bb-a07f-5abcc07f90e8', '8c626598-2d8a-4fe9-af09-c5ab252cb202'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] Delete snapshot completed successfully. Sep 17 15:05:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56411682-578d-47a7-b4fb-a61b8d848ad9 tempest-SnapshotsActionsTest-573001935 None] Lock "cinder-f84cb9a8-1655-46a5-8557-b78c2434a623-delete_snapshot" released by "delete_snapshot" :: held 2.934s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] Acquiring lock "cinder-36a25fcd-efea-40b4-b2c0-16629650c2ec-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] Lock "cinder-36a25fcd-efea-40b4-b2c0-16629650c2ec-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] Acquiring lock "cinder-quobyte-36a25fcd-efea-40b4-b2c0-16629650c2ec" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] Lock "cinder-quobyte-36a25fcd-efea-40b4-b2c0-16629650c2ec" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:56 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94776e1-823d-44a7-9d3d-a773af5bacae]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:56 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec Sep 17 15:05:56 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:57 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec" returned: 0 in 0.600s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:57 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec Sep 17 15:05:57 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:57 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-36a25fcd-efea-40b4-b2c0-16629650c2ec" returned: 0 in 0.285s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] Lock "cinder-quobyte-36a25fcd-efea-40b4-b2c0-16629650c2ec" released by "delete_volume" :: held 1.003s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:57 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] Created reservations ['62a66d36-9fc3-40c5-adf6-0cd8c3cbf7ce', 'e8cc1825-c764-4c44-8d1d-174803fa2489', '719ac623-d987-4c2a-83a7-212e86a66823', '8b7fd89f-34d9-4775-9655-d8984a964193'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:57 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:05:57 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:58 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.320s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:58 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:58 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] Deleted volume successfully. Sep 17 15:05:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-931e292d-bd5f-4a14-ab89-bb95ac9c1cd0 tempest-SnapshotsActionsTest-573001935 None] Lock "cinder-36a25fcd-efea-40b4-b2c0-16629650c2ec-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:06 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=174,cinder:SELECT=137,cinder:DELETE=15,cinder:INSERT=44 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:06:06 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=135,cinder:SELECT=126,cinder:DELETE=8,cinder:INSERT=46 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Flow 'volume_create_manager' (f8bf61a3-b042-4a24-bd8a-5d4701f43f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a6baae-9f95-4550-a64f-e79223e5e68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a6baae-9f95-4550-a64f-e79223e5e68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1804193272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2daca3bb-3885-438f-824a-906a0270e684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ec5b1ebe356424b8950ab01c6d1b914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:07Z,use_quota=True,user_id='51b41252bc934017846319e5363260d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485f8f10-2952-4396-a54f-86c31c138950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485f8f10-2952-4396-a54f-86c31c138950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db57f802-ac93-4f9f-a437-07033c3f4d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db57f802-ac93-4f9f-a437-07033c3f4d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2daca3bb-3885-438f-824a-906a0270e684', 'volume_name': 'volume-2daca3bb-3885-438f-824a-906a0270e684', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11410675-6345-4257-b5ec-9c2c4f317f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11410675-6345-4257-b5ec-9c2c4f317f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b81fdb-dc54-4087-b0c4-f41c4ae82624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:07 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Volume 2daca3bb-3885-438f-824a-906a0270e684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2daca3bb-3885-438f-824a-906a0270e684', 'volume_size': 1} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1804193272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2daca3bb-3885-438f-824a-906a0270e684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ec5b1ebe356424b8950ab01c6d1b914',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:07Z,use_quota=True,user_id='51b41252bc934017846319e5363260d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Creating volume 2daca3bb-3885-438f-824a-906a0270e684 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:06:07 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:07 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684 1073741824 Sep 17 15:06:07 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:07 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684 1073741824" returned: 0 in 0.505s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:07 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684 Sep 17 15:06:07 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:07 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684" returned: 0 in 0.286s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:06:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b81fdb-dc54-4087-b0c4-f41c4ae82624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2daca3bb-3885-438f-824a-906a0270e684', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc7c570d-3887-43ff-9304-4cc116075301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:08 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Volume volume-2daca3bb-3885-438f-824a-906a0270e684 (2daca3bb-3885-438f-824a-906a0270e684): created successfully Sep 17 15:06:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc7c570d-3887-43ff-9304-4cc116075301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Flow 'volume_create_manager' (f8bf61a3-b042-4a24-bd8a-5d4701f43f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:08 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-cdf42a1a-d422-4fd6-9b7d-30bfef99a599 tempest-VolumesSnapshotListTestJSON-235639343 None] Created volume successfully. Sep 17 15:06:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] Creating offline snapshot 37a17370-6677-4def-b31d-2842464ae2df of volume 2daca3bb-3885-438f-824a-906a0270e684 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:06:09 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ce258a-2761-4b4c-9179-a566deb99c0d]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:09 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684 Sep 17 15:06:09 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:09 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684" returned: 0 in 0.423s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:09 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df 1G Sep 17 15:06:09 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:10 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df 1G" returned: 0 in 0.582s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2daca3bb-3885-438f-824a-906a0270e684 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:10 devstack sudo[97914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2daca3bb-3885-438f-824a-906a0270e684 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df Sep 17 15:06:10 devstack sudo[97914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:10 devstack sudo[97914]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2daca3bb-3885-438f-824a-906a0270e684 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df" returned: 0 in 0.333s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:10 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df is being set with open permissions: ugo+rw Sep 17 15:06:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:10 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df Sep 17 15:06:10 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:11 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df" returned: 0 in 0.336s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:11 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.info Sep 17 15:06:11 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:11 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.info" returned: 0 in 0.298s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:11 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.info is being set with open permissions: ugo+rw Sep 17 15:06:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:11 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.info Sep 17 15:06:11 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:11 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.info" returned: 0 in 0.314s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.420s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a9bac050-6018-41e6-a469-d77cfa7db3bd tempest-VolumesSnapshotListTestJSON-235639343 None] Create snapshot completed successfully Sep 17 15:06:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-df2b418e-36a6-4186-ab1b-359588d3abe8 tempest-VolumesSnapshotListTestJSON-235639343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-df2b418e-36a6-4186-ab1b-359588d3abe8 tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-df2b418e-36a6-4186-ab1b-359588d3abe8 tempest-VolumesSnapshotListTestJSON-235639343 None] Creating offline snapshot 9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb of volume 2daca3bb-3885-438f-824a-906a0270e684 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:06:13 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce307c5-cab2-4394-95d5-1a73fcce3c0e]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-df2b418e-36a6-4186-ab1b-359588d3abe8 tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:13 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df Sep 17 15:06:13 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:13 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-df2b418e-36a6-4186-ab1b-359588d3abe8 tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df" returned: 0 in 0.680s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-df2b418e-36a6-4186-ab1b-359588d3abe8 tempest-VolumesSnapshotListTestJSON-235639343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2daca3bb-3885-438f-824a-906a0270e684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:06:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-df2b418e-36a6-4186-ab1b-359588d3abe8 tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:13 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb 1G Sep 17 15:06:13 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:14 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-df2b418e-36a6-4186-ab1b-359588d3abe8 tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb 1G" returned: 0 in 0.774s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-df2b418e-36a6-4186-ab1b-359588d3abe8 tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:14 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb Sep 17 15:06:14 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:15 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-df2b418e-36a6-4186-ab1b-359588d3abe8 tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb" returned: 0 in 0.582s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:15 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-df2b418e-36a6-4186-ab1b-359588d3abe8 tempest-VolumesSnapshotListTestJSON-235639343 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb is being set with open permissions: ugo+rw Sep 17 15:06:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-df2b418e-36a6-4186-ab1b-359588d3abe8 tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:15 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb Sep 17 15:06:15 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:15 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-df2b418e-36a6-4186-ab1b-359588d3abe8 tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb" returned: 0 in 0.292s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-df2b418e-36a6-4186-ab1b-359588d3abe8 tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.526s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-df2b418e-36a6-4186-ab1b-359588d3abe8 tempest-VolumesSnapshotListTestJSON-235639343 None] Create snapshot completed successfully Sep 17 15:06:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f47995ca-f03c-4a04-aa57-8d08587d5702 tempest-VolumesSnapshotListTestJSON-235639343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f47995ca-f03c-4a04-aa57-8d08587d5702 tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f47995ca-f03c-4a04-aa57-8d08587d5702 tempest-VolumesSnapshotListTestJSON-235639343 None] Creating offline snapshot fed6e917-6514-49e9-9313-899be683d1e8 of volume 2daca3bb-3885-438f-824a-906a0270e684 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:06:16 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a3b1f7-fa92-4b08-95b3-7b9e2f1ba10e]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f47995ca-f03c-4a04-aa57-8d08587d5702 tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:16 devstack sudo[97953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb Sep 17 15:06:16 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:16 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f47995ca-f03c-4a04-aa57-8d08587d5702 tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb" returned: 0 in 0.496s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f47995ca-f03c-4a04-aa57-8d08587d5702 tempest-VolumesSnapshotListTestJSON-235639343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2daca3bb-3885-438f-824a-906a0270e684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:06:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f47995ca-f03c-4a04-aa57-8d08587d5702 tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:16 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8 1G Sep 17 15:06:16 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:17 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:06:17 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Flow 'volume_create_manager' (f1114b85-2fd2-4630-b6ed-9636a56b7d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e399f4f2-ff39-4772-8447-f666cb5f5311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f47995ca-f03c-4a04-aa57-8d08587d5702 tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8 1G" returned: 0 in 0.744s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f47995ca-f03c-4a04-aa57-8d08587d5702 tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e399f4f2-ff39-4772-8447-f666cb5f5311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1375419473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1acabd-0ef0-40b0-b764-14be9157aa11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='413e266893ce4c32bef2578a0872ab46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:17Z,use_quota=True,user_id='2eb56de5708a4368a764928d161d5a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20add72c-b5a6-49e9-a351-42fcd02dcc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:17 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8 Sep 17 15:06:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20add72c-b5a6-49e9-a351-42fcd02dcc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e9a97d-e9ff-4507-9c63-42a7748b99c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:17 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e9a97d-e9ff-4507-9c63-42a7748b99c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d1acabd-0ef0-40b0-b764-14be9157aa11', 'volume_name': 'volume-1d1acabd-0ef0-40b0-b764-14be9157aa11', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f0ff77-c0dd-4307-9aba-f4e39aaffcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f0ff77-c0dd-4307-9aba-f4e39aaffcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd3a24a-38dd-45b0-a6eb-4ae31c567233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:17 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Volume 1d1acabd-0ef0-40b0-b764-14be9157aa11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d1acabd-0ef0-40b0-b764-14be9157aa11', 'volume_size': 1} Sep 17 15:06:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:18 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f47995ca-f03c-4a04-aa57-8d08587d5702 tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8" returned: 0 in 0.428s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:18 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-f47995ca-f03c-4a04-aa57-8d08587d5702 tempest-VolumesSnapshotListTestJSON-235639343 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8 is being set with open permissions: ugo+rw Sep 17 15:06:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f47995ca-f03c-4a04-aa57-8d08587d5702 tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:18 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8 Sep 17 15:06:18 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:18 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f47995ca-f03c-4a04-aa57-8d08587d5702 tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8" returned: 0 in 0.294s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f47995ca-f03c-4a04-aa57-8d08587d5702 tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.708s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1375419473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1acabd-0ef0-40b0-b764-14be9157aa11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='413e266893ce4c32bef2578a0872ab46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:17Z,use_quota=True,user_id='2eb56de5708a4368a764928d161d5a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:06:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Creating volume 1d1acabd-0ef0-40b0-b764-14be9157aa11 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:06:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:06:18 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:06:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d1acabd-0ef0-40b0-b764-14be9157aa11 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:18 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d1acabd-0ef0-40b0-b764-14be9157aa11 1073741824 Sep 17 15:06:18 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f47995ca-f03c-4a04-aa57-8d08587d5702 tempest-VolumesSnapshotListTestJSON-235639343 None] Create snapshot completed successfully Sep 17 15:06:18 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d1acabd-0ef0-40b0-b764-14be9157aa11 1073741824" returned: 0 in 0.552s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d1acabd-0ef0-40b0-b764-14be9157aa11 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:19 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d1acabd-0ef0-40b0-b764-14be9157aa11 Sep 17 15:06:19 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:19 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d1acabd-0ef0-40b0-b764-14be9157aa11" returned: 0 in 0.310s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:06:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd3a24a-38dd-45b0-a6eb-4ae31c567233) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d1acabd-0ef0-40b0-b764-14be9157aa11', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7965dbc8-fdbb-40df-8b6a-da59f5356af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:19 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Volume volume-1d1acabd-0ef0-40b0-b764-14be9157aa11 (1d1acabd-0ef0-40b0-b764-14be9157aa11): created successfully Sep 17 15:06:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7965dbc8-fdbb-40df-8b6a-da59f5356af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Flow 'volume_create_manager' (f1114b85-2fd2-4630-b6ed-9636a56b7d71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:19 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3ec40173-102c-44be-956e-a11d7fc875e5 tempest-AttachVolumeTestJSON-1182212184 None] Created volume successfully. Sep 17 15:06:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] Acquiring lock "cinder-fed6e917-6514-49e9-9313-899be683d1e8-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-fed6e917-6514-49e9-9313-899be683d1e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] Acquiring lock "cinder-quobyte-2daca3bb-3885-438f-824a-906a0270e684" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-quobyte-2daca3bb-3885-438f-824a-906a0270e684" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] Acquiring lock "cinder-quobyte-fed6e917-6514-49e9-9313-899be683d1e8" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-quobyte-fed6e917-6514-49e9-9313-899be683d1e8" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] Deleting offline snapshot fed6e917-6514-49e9-9313-899be683d1e8 of volume 2daca3bb-3885-438f-824a-906a0270e684 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:06:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] snapshot_file for this snap is: volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:06:20 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7e5665-c799-4331-80ee-0c1e94d39c86]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:21 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8 Sep 17 15:06:21 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-f9ff68a3-5021-44d9-8859-eb3bc5c22163 req-a0c94b6b-1479-4237-82b5-a870e0de00c8 tempest-AttachVolumeTestJSON-1182212184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-f9ff68a3-5021-44d9-8859-eb3bc5c22163 req-a0c94b6b-1479-4237-82b5-a870e0de00c8 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-f9ff68a3-5021-44d9-8859-eb3bc5c22163 req-a0c94b6b-1479-4237-82b5-a870e0de00c8 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-f9ff68a3-5021-44d9-8859-eb3bc5c22163 req-a0c94b6b-1479-4237-82b5-a870e0de00c8 tempest-AttachVolumeTestJSON-1182212184 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-1d1acabd-0ef0-40b0-b764-14be9157aa11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29daa4c1-a200-4fae-83fa-8b1491f214aa', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:06:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-f9ff68a3-5021-44d9-8859-eb3bc5c22163 req-a0c94b6b-1479-4237-82b5-a870e0de00c8 tempest-AttachVolumeTestJSON-1182212184 None] attachment_update completed successfully. Sep 17 15:06:21 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8" returned: 0 in 0.486s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2daca3bb-3885-438f-824a-906a0270e684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:06:21 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[9215af30-b113-4df1-9d37-17b1b4038c1f]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:21 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb Sep 17 15:06:21 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:21 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb" returned: 0 in 0.551s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2daca3bb-3885-438f-824a-906a0270e684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:06:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:22 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8 Sep 17 15:06:22 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:22 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8" returned: 0 in 0.632s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:22 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8 Sep 17 15:06:22 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:22 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.fed6e917-6514-49e9-9313-899be683d1e8" returned: 0 in 0.367s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-quobyte-fed6e917-6514-49e9-9313-899be683d1e8" released by "_delete_snapshot" :: held 2.197s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-quobyte-2daca3bb-3885-438f-824a-906a0270e684" released by "delete_snapshot" :: held 2.236s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] Created reservations ['530971db-0ed8-4791-bcce-a7cda1118fe4', 'da718a03-718d-4152-98eb-c156ad938af5', '692249e8-98b1-4214-bf65-8f2187f76234', '88e4a459-a1c8-4d88-aef0-556637061486'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] Delete snapshot completed successfully. Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-73fee852-9f40-4525-bf1f-a830e4350dce tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-fed6e917-6514-49e9-9313-899be683d1e8-delete_snapshot" released by "delete_snapshot" :: held 2.432s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Flow 'volume_create_manager' (e9dc7a72-b820-4e14-86ed-c0ce842789d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d2686c-c44b-433a-99e4-373a72921b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d2686c-c44b-433a-99e4-373a72921b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-234474780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f364025-3659-4ab5-92e1-27c5dad750d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='413e266893ce4c32bef2578a0872ab46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:24Z,use_quota=True,user_id='2eb56de5708a4368a764928d161d5a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd4ec784-983b-4876-afbe-972abb0060e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd4ec784-983b-4876-afbe-972abb0060e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a31a2d-3cfb-4482-bad2-8091a487e961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a31a2d-3cfb-4482-bad2-8091a487e961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f364025-3659-4ab5-92e1-27c5dad750d3', 'volume_name': 'volume-5f364025-3659-4ab5-92e1-27c5dad750d3', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fcbf6c-7cfd-4085-b900-0285db2499b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fcbf6c-7cfd-4085-b900-0285db2499b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (268e03b0-2f39-4cd7-b999-7be9ee1621f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:23 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Volume 5f364025-3659-4ab5-92e1-27c5dad750d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f364025-3659-4ab5-92e1-27c5dad750d3', 'volume_size': 1} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-234474780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f364025-3659-4ab5-92e1-27c5dad750d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='413e266893ce4c32bef2578a0872ab46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:24Z,use_quota=True,user_id='2eb56de5708a4368a764928d161d5a65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Creating volume 5f364025-3659-4ab5-92e1-27c5dad750d3 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:06:23 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:06:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5f364025-3659-4ab5-92e1-27c5dad750d3 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:24 devstack sudo[98430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5f364025-3659-4ab5-92e1-27c5dad750d3 1073741824 Sep 17 15:06:24 devstack sudo[98430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] Acquiring lock "cinder-9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Flow 'volume_create_manager' (7daaa46f-81d9-4274-82f8-a3890357199d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d5ca5e-a893-4319-88df-1a3581f5b2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] Acquiring lock "cinder-quobyte-2daca3bb-3885-438f-824a-906a0270e684" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d5ca5e-a893-4319-88df-1a3581f5b2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-194604333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a02a778-78ab-4bd6-9228-9847f358f917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6be1e7cb3acd432fa1df1abe0b3a18df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:24Z,use_quota=True,user_id='49f6394fa9f147cab4c22582540095b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604be9b5-b391-4202-8399-3e2f0d94873c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604be9b5-b391-4202-8399-3e2f0d94873c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8a6d51-b090-4272-aee7-b1b7fe92fbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce8a6d51-b090-4272-aee7-b1b7fe92fbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a02a778-78ab-4bd6-9228-9847f358f917', 'volume_name': 'volume-8a02a778-78ab-4bd6-9228-9847f358f917', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8b7d22-2f1f-4d6a-9467-6efcdd577d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8b7d22-2f1f-4d6a-9467-6efcdd577d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046fbe60-39b0-4fc6-83b7-0fc62328d0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:24 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Volume 8a02a778-78ab-4bd6-9228-9847f358f917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a02a778-78ab-4bd6-9228-9847f358f917', 'volume_size': 1} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-quobyte-2daca3bb-3885-438f-824a-906a0270e684" acquired by "delete_snapshot" :: waited 0.082s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] Acquiring lock "cinder-quobyte-9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-quobyte-9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] Deleting offline snapshot 9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb of volume 2daca3bb-3885-438f-824a-906a0270e684 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] snapshot_file for this snap is: volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4808de85-5546-4f6b-bd97-9f4632014347]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:24 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb Sep 17 15:06:24 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:24 devstack sudo[98430]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5f364025-3659-4ab5-92e1-27c5dad750d3 1073741824" returned: 0 in 0.570s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5f364025-3659-4ab5-92e1-27c5dad750d3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:24 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5f364025-3659-4ab5-92e1-27c5dad750d3 Sep 17 15:06:24 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:24 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb" returned: 0 in 0.455s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2daca3bb-3885-438f-824a-906a0270e684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44a16d0-2c62-45fb-90c9-5f2d6acb72e1]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:24 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5f364025-3659-4ab5-92e1-27c5dad750d3" returned: 0 in 0.300s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.628s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-194604333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a02a778-78ab-4bd6-9228-9847f358f917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6be1e7cb3acd432fa1df1abe0b3a18df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:24Z,use_quota=True,user_id='49f6394fa9f147cab4c22582540095b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Creating volume 8a02a778-78ab-4bd6-9228-9847f358f917 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:06:24 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8a02a778-78ab-4bd6-9228-9847f358f917 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (268e03b0-2f39-4cd7-b999-7be9ee1621f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f364025-3659-4ab5-92e1-27c5dad750d3', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:24 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df Sep 17 15:06:24 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8a02a778-78ab-4bd6-9228-9847f358f917 1073741824 Sep 17 15:06:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd18f495-67b1-4545-86d7-380400416e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:24 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:24 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:25 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Volume volume-5f364025-3659-4ab5-92e1-27c5dad750d3 (5f364025-3659-4ab5-92e1-27c5dad750d3): created successfully Sep 17 15:06:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd18f495-67b1-4545-86d7-380400416e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Flow 'volume_create_manager' (e9dc7a72-b820-4e14-86ed-c0ce842789d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e8bd6558-f93a-44b0-afea-a06c3c62ad27 tempest-AttachVolumeTestJSON-1182212184 None] Created volume successfully. Sep 17 15:06:25 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df" returned: 0 in 0.468s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2daca3bb-3885-438f-824a-906a0270e684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:06:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:25 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb Sep 17 15:06:25 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:25 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8a02a778-78ab-4bd6-9228-9847f358f917 1073741824" returned: 0 in 0.595s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8a02a778-78ab-4bd6-9228-9847f358f917 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:25 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8a02a778-78ab-4bd6-9228-9847f358f917 Sep 17 15:06:25 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:25 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb" returned: 0 in 0.458s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:25 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb Sep 17 15:06:25 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:25 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8a02a778-78ab-4bd6-9228-9847f358f917" returned: 0 in 0.311s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:06:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046fbe60-39b0-4fc6-83b7-0fc62328d0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a02a778-78ab-4bd6-9228-9847f358f917', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1606aa78-b692-4ab2-b213-6c71c21301f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:25 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Volume volume-8a02a778-78ab-4bd6-9228-9847f358f917 (8a02a778-78ab-4bd6-9228-9847f358f917): created successfully Sep 17 15:06:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1606aa78-b692-4ab2-b213-6c71c21301f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Flow 'volume_create_manager' (7daaa46f-81d9-4274-82f8-a3890357199d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b99f1257-978b-4007-bc89-2973a40650ca tempest-VolumeQuotasNegativeTestJSON-960052819 None] Created volume successfully. Sep 17 15:06:26 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb" returned: 0 in 0.356s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-quobyte-9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb" released by "_delete_snapshot" :: held 1.870s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-quobyte-2daca3bb-3885-438f-824a-906a0270e684" released by "delete_snapshot" :: held 1.897s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:26 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] Created reservations ['8244bb84-c62f-44f3-b3f6-8a842d946145', 'b5fae24f-54bc-4d19-8bf8-3a014e1301ed', 'afdf5ad6-4068-4eb6-b559-c49280d995a2', 'a91712cf-912c-4ccd-a9e2-e72e13ad17ca'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] Delete snapshot completed successfully. Sep 17 15:06:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8fea01a8-8db0-40fd-b41c-fd474abe46be tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-9fe60ee9-b9bd-4f37-8690-d03e27fcfbdb-delete_snapshot" released by "delete_snapshot" :: held 2.169s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-2fd5fedf-33b4-471f-a1b0-be7de0c9c5b6 req-ae1a2663-c741-48af-923a-fe4ede82e62e tempest-AttachVolumeTestJSON-1182212184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-2fd5fedf-33b4-471f-a1b0-be7de0c9c5b6 req-ae1a2663-c741-48af-923a-fe4ede82e62e tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-2fd5fedf-33b4-471f-a1b0-be7de0c9c5b6 req-ae1a2663-c741-48af-923a-fe4ede82e62e tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-2fd5fedf-33b4-471f-a1b0-be7de0c9c5b6 req-ae1a2663-c741-48af-923a-fe4ede82e62e tempest-AttachVolumeTestJSON-1182212184 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-5f364025-3659-4ab5-92e1-27c5dad750d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0568e545-aa08-4936-a116-fd615f191111', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:06:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-2fd5fedf-33b4-471f-a1b0-be7de0c9c5b6 req-ae1a2663-c741-48af-923a-fe4ede82e62e tempest-AttachVolumeTestJSON-1182212184 None] attachment_update completed successfully. Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] Acquiring lock "cinder-37a17370-6677-4def-b31d-2842464ae2df-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-37a17370-6677-4def-b31d-2842464ae2df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] Acquiring lock "cinder-quobyte-2daca3bb-3885-438f-824a-906a0270e684" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] Acquiring lock "cinder-8a02a778-78ab-4bd6-9228-9847f358f917-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-quobyte-2daca3bb-3885-438f-824a-906a0270e684" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] Acquiring lock "cinder-quobyte-37a17370-6677-4def-b31d-2842464ae2df" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] Lock "cinder-8a02a778-78ab-4bd6-9228-9847f358f917-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-quobyte-37a17370-6677-4def-b31d-2842464ae2df" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] Deleting offline snapshot 37a17370-6677-4def-b31d-2842464ae2df of volume 2daca3bb-3885-438f-824a-906a0270e684 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] snapshot_file for this snap is: volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[57375453-fa03-46b9-82d2-deb9a41a85bb]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] Acquiring lock "cinder-quobyte-8a02a778-78ab-4bd6-9228-9847f358f917" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] Lock "cinder-quobyte-8a02a778-78ab-4bd6-9228-9847f358f917" acquired by "delete_volume" :: waited 0.059s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ebb954-9f07-4d80-9414-54fa178d181f]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8a02a778-78ab-4bd6-9228-9847f358f917 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:27 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df Sep 17 15:06:27 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:27 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8a02a778-78ab-4bd6-9228-9847f358f917 Sep 17 15:06:27 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:28 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df" returned: 0 in 0.534s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2daca3bb-3885-438f-824a-906a0270e684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:06:28 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[87594823-c3ba-4ae3-a667-c4c8dc156008]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:28 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8a02a778-78ab-4bd6-9228-9847f358f917" returned: 0 in 0.511s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8a02a778-78ab-4bd6-9228-9847f358f917 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:28 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684 Sep 17 15:06:28 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:28 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8a02a778-78ab-4bd6-9228-9847f358f917 Sep 17 15:06:28 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:28 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684" returned: 0 in 0.419s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:28 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8a02a778-78ab-4bd6-9228-9847f358f917" returned: 0 in 0.326s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] Lock "cinder-quobyte-8a02a778-78ab-4bd6-9228-9847f358f917" released by "delete_volume" :: held 0.922s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:28 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df Sep 17 15:06:28 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:28 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] Created reservations ['ba783665-f579-4def-8dec-4d669330f4a4', '3ca3ec9a-ef53-46ae-80c9-c8e0fff93bc5', 'ce571b04-8cd7-4f2a-ac21-e8626b0d8556', '1a66e8fb-6b73-44e9-a15f-e1e48bd695d9'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:28 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:06:28 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:29 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df" returned: 0 in 0.460s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:29 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df Sep 17 15:06:29 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:29 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.328s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:29 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:06:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] Deleted volume successfully. Sep 17 15:06:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-11beab5a-9ad7-4ee2-b843-c46f0c6d88ea tempest-VolumeQuotasNegativeTestJSON-960052819 None] Lock "cinder-8a02a778-78ab-4bd6-9228-9847f358f917-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:29 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684.37a17370-6677-4def-b31d-2842464ae2df" returned: 0 in 0.284s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-quobyte-37a17370-6677-4def-b31d-2842464ae2df" released by "_delete_snapshot" :: held 1.842s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-quobyte-2daca3bb-3885-438f-824a-906a0270e684" released by "delete_snapshot" :: held 1.878s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:29 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] Created reservations ['a013b2d2-a342-4f32-b484-3ac126e1db46', '9779bfc3-0fad-4d2b-a3b8-aceadad227ae', '86fbe332-b937-4d69-9b1e-85adb8dc7828', '37c3e6be-470f-42ea-a558-a1f62f5504be'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] Delete snapshot completed successfully. Sep 17 15:06:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-21ffcc26-b0d0-460c-ba2c-86f0a9f5b175 tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-37a17370-6677-4def-b31d-2842464ae2df-delete_snapshot" released by "delete_snapshot" :: held 2.099s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] Acquiring lock "cinder-2daca3bb-3885-438f-824a-906a0270e684-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-2daca3bb-3885-438f-824a-906a0270e684-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] Acquiring lock "cinder-quobyte-2daca3bb-3885-438f-824a-906a0270e684" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-quobyte-2daca3bb-3885-438f-824a-906a0270e684" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:29 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acc00af-73dd-492c-9d5b-4b4a683c3951]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:30 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-e1a444d7-00ab-4919-bced-219dd2fd0866 req-cba49e4f-3d98-428e-988a-d1c15678560b tempest-AttachVolumeTestJSON-1182212184 None] Terminate volume connection completed successfully. Sep 17 15:06:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-e1a444d7-00ab-4919-bced-219dd2fd0866 req-cba49e4f-3d98-428e-988a-d1c15678560b tempest-AttachVolumeTestJSON-1182212184 None] Deleting attachment 29daa4c1-a200-4fae-83fa-8b1491f214aa. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:06:30 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684 Sep 17 15:06:30 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:30 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684" returned: 0 in 0.564s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:30 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684 Sep 17 15:06:30 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:30 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2daca3bb-3885-438f-824a-906a0270e684" returned: 0 in 0.264s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-quobyte-2daca3bb-3885-438f-824a-906a0270e684" released by "delete_volume" :: held 0.954s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:30 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] Created reservations ['52116ead-b0d8-461c-bb2c-3867db5cc1f4', '746bcac1-892d-4d72-87f1-88c62998411d', 'e1423bd5-c6a8-42c6-912a-3e436309a2f2', '1a38fb3e-69ac-4d1b-890f-e830188f44b9'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:31 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:06:31 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:31 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.320s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:31 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:06:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] Deleted volume successfully. Sep 17 15:06:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e52c91f2-3ba7-4317-a13a-c49ccba3222f tempest-VolumesSnapshotListTestJSON-235639343 None] Lock "cinder-2daca3bb-3885-438f-824a-906a0270e684-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-2a889186-d2cb-417c-90a6-4afe0995265b req-aa4518ba-c21e-4411-9692-adcb8e70cdbc tempest-AttachVolumeTestJSON-1182212184 None] Terminate volume connection completed successfully. Sep 17 15:06:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-2a889186-d2cb-417c-90a6-4afe0995265b req-aa4518ba-c21e-4411-9692-adcb8e70cdbc tempest-AttachVolumeTestJSON-1182212184 None] Deleting attachment 0568e545-aa08-4936-a116-fd615f191111. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:06:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] Acquiring lock "cinder-5f364025-3659-4ab5-92e1-27c5dad750d3-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] Lock "cinder-5f364025-3659-4ab5-92e1-27c5dad750d3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] Acquiring lock "cinder-quobyte-5f364025-3659-4ab5-92e1-27c5dad750d3" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] Lock "cinder-quobyte-5f364025-3659-4ab5-92e1-27c5dad750d3" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:38 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65e64d9-2dee-4220-8fe0-2a570201bf44]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5f364025-3659-4ab5-92e1-27c5dad750d3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:39 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5f364025-3659-4ab5-92e1-27c5dad750d3 Sep 17 15:06:39 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:39 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5f364025-3659-4ab5-92e1-27c5dad750d3" returned: 0 in 0.626s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5f364025-3659-4ab5-92e1-27c5dad750d3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:39 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5f364025-3659-4ab5-92e1-27c5dad750d3 Sep 17 15:06:39 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Flow 'volume_create_manager' (63969386-c125-4ccb-8d79-9188d6f378ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b26c03-0182-4fc8-9e03-c774c18176c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b26c03-0182-4fc8-9e03-c774c18176c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1875336341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a15bbaec0e0490c9673bc9a3f626d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:40Z,use_quota=True,user_id='b884bce69ba1418b8ed143901283b0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04bfa750-2f6f-4950-ae57-67fad487e345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04bfa750-2f6f-4950-ae57-67fad487e345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e87cad3-5965-4983-b23f-ffe9ba20c280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e87cad3-5965-4983-b23f-ffe9ba20c280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d', 'volume_name': 'volume-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb3cf51-208d-4ea0-a869-91d2e7795fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbb3cf51-208d-4ea0-a869-91d2e7795fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0122ef20-c8c7-4125-a446-be3270b207c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:39 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Volume 0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d', 'volume_size': 1} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1875336341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a15bbaec0e0490c9673bc9a3f626d2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:40Z,use_quota=True,user_id='b884bce69ba1418b8ed143901283b0cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Creating volume 0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:06:39 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:39 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d 1073741824 Sep 17 15:06:39 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:39 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5f364025-3659-4ab5-92e1-27c5dad750d3" returned: 0 in 0.335s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] Lock "cinder-quobyte-5f364025-3659-4ab5-92e1-27c5dad750d3" released by "delete_volume" :: held 1.061s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] Created reservations ['93db2a94-4bfd-43aa-995a-a1b238228dc6', '9cf52655-057e-4757-86ef-5d948992f3db', 'fd74f294-01fc-4404-a8d3-2ce29c7314e1', '350b19dc-e85c-4992-b79a-30626b09eeec'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:40 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:06:40 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:40 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:06:40 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:40 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d 1073741824" returned: 0 in 0.773s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:40 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.368s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:40 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] Deleted volume successfully. Sep 17 15:06:40 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d Sep 17 15:06:40 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-871ab04c-0701-42e9-9566-fc4b3230675b tempest-AttachVolumeTestJSON-1182212184 None] Lock "cinder-5f364025-3659-4ab5-92e1-27c5dad750d3-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:40 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.392s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:06:40 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d" returned: 0 in 0.312s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0122ef20-c8c7-4125-a446-be3270b207c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c13be42-c532-4673-a1c0-ba724ee6d299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:40 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Volume volume-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d (0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d): created successfully Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c13be42-c532-4673-a1c0-ba724ee6d299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Flow 'volume_create_manager' (63969386-c125-4ccb-8d79-9188d6f378ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-74164c3a-acbe-45f6-b6df-5ecd02475fa7 tempest-VolumesServicesTestJSON-1295195888 None] Created volume successfully. Sep 17 15:06:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] Acquiring lock "cinder-1d1acabd-0ef0-40b0-b764-14be9157aa11-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] Lock "cinder-1d1acabd-0ef0-40b0-b764-14be9157aa11-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] Acquiring lock "cinder-quobyte-1d1acabd-0ef0-40b0-b764-14be9157aa11" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] Lock "cinder-quobyte-1d1acabd-0ef0-40b0-b764-14be9157aa11" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:41 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf19bba1-2df6-4d63-93fa-856bc7141819]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d1acabd-0ef0-40b0-b764-14be9157aa11 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:41 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d1acabd-0ef0-40b0-b764-14be9157aa11 Sep 17 15:06:41 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:41 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d1acabd-0ef0-40b0-b764-14be9157aa11" returned: 0 in 0.454s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d1acabd-0ef0-40b0-b764-14be9157aa11 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:41 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d1acabd-0ef0-40b0-b764-14be9157aa11 Sep 17 15:06:41 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] Acquiring lock "cinder-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] Lock "cinder-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] Acquiring lock "cinder-quobyte-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] Lock "cinder-quobyte-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:42 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b051fe7e-0d04-4412-8061-ae475ee5aaf2]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:42 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d1acabd-0ef0-40b0-b764-14be9157aa11" returned: 0 in 0.446s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] Lock "cinder-quobyte-1d1acabd-0ef0-40b0-b764-14be9157aa11" released by "delete_volume" :: held 0.963s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:42 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d Sep 17 15:06:42 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:42 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] Created reservations ['60b6c9e8-f929-437b-b44a-0b3437feea69', 'c33ba67a-7a41-45c7-a5f6-dc1302a5554e', '4eb8f30a-b463-4099-ae7c-363d7b99a20b', '0706abac-0e61-4836-813e-db5e15387e35'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:42 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:06:42 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:42 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d" returned: 0 in 0.536s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:42 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d Sep 17 15:06:42 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:42 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.322s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:42 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:06:42 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] Deleted volume successfully. Sep 17 15:06:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b1fdfc05-13c4-4cfc-94cd-8ba59be12280 tempest-AttachVolumeTestJSON-1182212184 None] Lock "cinder-1d1acabd-0ef0-40b0-b764-14be9157aa11-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:43 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d" returned: 0 in 0.515s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] Lock "cinder-quobyte-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d" released by "delete_volume" :: held 1.111s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:43 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] Created reservations ['9eda5c92-003a-404e-a263-c2758ea3f359', '42462d75-f8bc-4137-a094-3a857d4678f8', '7c5c4582-c179-449d-9d9c-c66fe24209b8', '18f0ebfc-c8da-49a4-80f4-4aa265f80772'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:43 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:06:43 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] Acquiring lock "cinder-1e9050a5-802f-4f01-aed9-c97474919bd3-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] Lock "cinder-1e9050a5-802f-4f01-aed9-c97474919bd3-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] Acquiring lock "cinder-quobyte-1e9050a5-802f-4f01-aed9-c97474919bd3" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] Lock "cinder-quobyte-1e9050a5-802f-4f01-aed9-c97474919bd3" acquired by "delete_volume" :: waited 0.049s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:43 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.505s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:44 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:06:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] Deleted volume successfully. Sep 17 15:06:44 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9c5a54-78a0-4b00-bdba-d5bfca6e9de1]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1e9050a5-802f-4f01-aed9-c97474919bd3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-94a2c610-1b2e-4087-9cb1-66a6299de91c tempest-VolumesServicesTestJSON-1295195888 None] Lock "cinder-0fd6b9d0-55a6-4a6d-b0b7-857bfae2814d-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:44 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1e9050a5-802f-4f01-aed9-c97474919bd3 Sep 17 15:06:44 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:45 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1e9050a5-802f-4f01-aed9-c97474919bd3" returned: 0 in 0.971s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1e9050a5-802f-4f01-aed9-c97474919bd3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:45 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1e9050a5-802f-4f01-aed9-c97474919bd3 Sep 17 15:06:45 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:45 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1e9050a5-802f-4f01-aed9-c97474919bd3" returned: 0 in 0.678s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] Lock "cinder-quobyte-1e9050a5-802f-4f01-aed9-c97474919bd3" released by "delete_volume" :: held 1.796s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:45 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] Created reservations ['7ce27d1d-4555-49ae-86f6-f695e12b7c1d', '00b84fb7-63a9-4d6e-9dc0-5f4d6d9bcc9f', '575591b2-35f9-48cd-b171-f24bb426aa42', 'c3fb67f9-0a68-470a-8a98-e58082b909e7'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:46 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:06:46 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:46 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.331s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:46 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:06:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] Deleted volume successfully. Sep 17 15:06:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f95b5075-d567-4666-a6ed-de3e7f3e0291 tempest-AttachVolumeTestJSON-1182212184 None] Lock "cinder-1e9050a5-802f-4f01-aed9-c97474919bd3-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:55 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=77,cinder:UPDATE=79,cinder:DELETE=7,cinder:INSERT=13 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:06:56 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=78,cinder:UPDATE=92,cinder:INSERT=29,cinder:DELETE=7 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:06:57 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:06:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Flow 'volume_create_manager' (5411e60c-41fc-4e8e-a02d-408c54109ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e7a587-f442-4e74-9d15-98c3fd04fe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e7a587-f442-4e74-9d15-98c3fd04fe11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1752569701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d52c85-8608-4f89-8880-412f3251ef85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42aa6ed1a0f5462bb353a50df08132af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:58Z,use_quota=True,user_id='6d36762d58b84467b0d446c5eaefe392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97dff96-538c-49e5-8533-d01c72b3e712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97dff96-538c-49e5-8533-d01c72b3e712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67fd5d9a-0527-48eb-a3b4-9da995ad267a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67fd5d9a-0527-48eb-a3b4-9da995ad267a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d52c85-8608-4f89-8880-412f3251ef85', 'volume_name': 'volume-04d52c85-8608-4f89-8880-412f3251ef85', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad24301-6d0a-4ed8-8944-43a4bb747c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad24301-6d0a-4ed8-8944-43a4bb747c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca85e8ed-98e3-4865-9825-413d26823397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:58 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Volume 04d52c85-8608-4f89-8880-412f3251ef85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d52c85-8608-4f89-8880-412f3251ef85', 'volume_size': 1} Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1752569701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d52c85-8608-4f89-8880-412f3251ef85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42aa6ed1a0f5462bb353a50df08132af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:58Z,use_quota=True,user_id='6d36762d58b84467b0d446c5eaefe392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Creating volume 04d52c85-8608-4f89-8880-412f3251ef85 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:06:58 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-04d52c85-8608-4f89-8880-412f3251ef85 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:58 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-04d52c85-8608-4f89-8880-412f3251ef85 1073741824 Sep 17 15:06:58 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:58 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-04d52c85-8608-4f89-8880-412f3251ef85 1073741824" returned: 0 in 0.563s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-04d52c85-8608-4f89-8880-412f3251ef85 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:58 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-04d52c85-8608-4f89-8880-412f3251ef85 Sep 17 15:06:58 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:58 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-04d52c85-8608-4f89-8880-412f3251ef85" returned: 0 in 0.301s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca85e8ed-98e3-4865-9825-413d26823397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d52c85-8608-4f89-8880-412f3251ef85', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08266190-fefd-4c15-a9ce-c8a0ae9e43a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:59 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Volume volume-04d52c85-8608-4f89-8880-412f3251ef85 (04d52c85-8608-4f89-8880-412f3251ef85): created successfully Sep 17 15:06:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08266190-fefd-4c15-a9ce-c8a0ae9e43a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Flow 'volume_create_manager' (5411e60c-41fc-4e8e-a02d-408c54109ffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f4406426-752d-4f67-9307-3e15df5cbae8 tempest-VolumesListAdminTestJSON-459466604 None] Created volume successfully. Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Flow 'volume_create_manager' (5a4ce65b-e72c-4a63-8810-273b63101ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5703cbf-f904-4b6b-ab79-67854136f22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5703cbf-f904-4b6b-ab79-67854136f22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1603239160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea0927f-7cfd-4c73-95c8-a8a0eafaebff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42aa6ed1a0f5462bb353a50df08132af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:00Z,use_quota=True,user_id='6d36762d58b84467b0d446c5eaefe392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48ef0c89-7d71-40e9-a04c-1bfbfbf6c2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48ef0c89-7d71-40e9-a04c-1bfbfbf6c2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad8d3e3-e01d-44e2-85cc-9225a798dec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad8d3e3-e01d-44e2-85cc-9225a798dec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ea0927f-7cfd-4c73-95c8-a8a0eafaebff', 'volume_name': 'volume-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0b2a12-55d0-4450-b24f-3cf841bfc246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0b2a12-55d0-4450-b24f-3cf841bfc246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff701beb-19b7-44e0-9032-80a5dbd233c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:00 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Volume 4ea0927f-7cfd-4c73-95c8-a8a0eafaebff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff', 'volume_size': 1} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1603239160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea0927f-7cfd-4c73-95c8-a8a0eafaebff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42aa6ed1a0f5462bb353a50df08132af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:00Z,use_quota=True,user_id='6d36762d58b84467b0d446c5eaefe392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Creating volume 4ea0927f-7cfd-4c73-95c8-a8a0eafaebff {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:07:00 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:07:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:00 devstack sudo[98782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff 1073741824 Sep 17 15:07:00 devstack sudo[98782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:01 devstack sudo[98782]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff 1073741824" returned: 0 in 0.639s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:01 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff Sep 17 15:07:01 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:01 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff" returned: 0 in 0.326s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:07:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff701beb-19b7-44e0-9032-80a5dbd233c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d04125-8b3c-4b1a-ad7b-14cd6627b680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:01 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Volume volume-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff (4ea0927f-7cfd-4c73-95c8-a8a0eafaebff): created successfully Sep 17 15:07:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d04125-8b3c-4b1a-ad7b-14cd6627b680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Flow 'volume_create_manager' (5a4ce65b-e72c-4a63-8810-273b63101ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:01 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e5079cd8-d0b3-475a-85a5-6a25983fe6a0 tempest-VolumesListAdminTestJSON-459466604 None] Created volume successfully. Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Flow 'volume_create_manager' (5c20c3fa-ba6d-4355-8644-9b7f6457c70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77caf00d-510a-4116-9159-98d210b9a823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77caf00d-510a-4116-9159-98d210b9a823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-125666405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da3b040-ccb2-4763-8f5e-c854cdbc639f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4201aaf36e74e65a9a1ca43f4221287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:02Z,use_quota=True,user_id='5ff93e0ce4a148a7852dd712fb17121a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa005a6-a19d-40b5-b2f0-9da139f5f9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa005a6-a19d-40b5-b2f0-9da139f5f9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f13b1f-c05d-429a-be86-64955faa2366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f13b1f-c05d-429a-be86-64955faa2366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5da3b040-ccb2-4763-8f5e-c854cdbc639f', 'volume_name': 'volume-5da3b040-ccb2-4763-8f5e-c854cdbc639f', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112261a5-d307-4c63-9396-e1d6f8d7c8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (112261a5-d307-4c63-9396-e1d6f8d7c8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee53017-0ace-408a-8dbf-caeeac6d9209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:02 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Volume 5da3b040-ccb2-4763-8f5e-c854cdbc639f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5da3b040-ccb2-4763-8f5e-c854cdbc639f', 'volume_size': 1} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-125666405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da3b040-ccb2-4763-8f5e-c854cdbc639f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c4201aaf36e74e65a9a1ca43f4221287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:02Z,use_quota=True,user_id='5ff93e0ce4a148a7852dd712fb17121a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Creating volume 5da3b040-ccb2-4763-8f5e-c854cdbc639f {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:07:02 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5da3b040-ccb2-4763-8f5e-c854cdbc639f 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:02 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5da3b040-ccb2-4763-8f5e-c854cdbc639f 1073741824 Sep 17 15:07:02 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:02 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5da3b040-ccb2-4763-8f5e-c854cdbc639f 1073741824" returned: 0 in 0.566s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5da3b040-ccb2-4763-8f5e-c854cdbc639f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:02 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5da3b040-ccb2-4763-8f5e-c854cdbc639f Sep 17 15:07:02 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:03 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5da3b040-ccb2-4763-8f5e-c854cdbc639f" returned: 0 in 0.344s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee53017-0ace-408a-8dbf-caeeac6d9209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5da3b040-ccb2-4763-8f5e-c854cdbc639f', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494a3d1f-8c37-4fcc-813b-6c32dff2de8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:03 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Volume volume-5da3b040-ccb2-4763-8f5e-c854cdbc639f (5da3b040-ccb2-4763-8f5e-c854cdbc639f): created successfully Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494a3d1f-8c37-4fcc-813b-6c32dff2de8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Flow 'volume_create_manager' (5c20c3fa-ba6d-4355-8644-9b7f6457c70f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-80dd0e00-4b43-4568-a5d7-de59a5c5d1fb req-39195767-bf6a-4cd9-9b7e-158bebff4c17 tempest-VolumesGetTestJSON-1718044564 None] Created volume successfully. Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Flow 'volume_create_manager' (f3bd3d3b-e276-4ae1-9f98-c27f45eb62fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ff8ac5-bc7c-404c-a5e4-c31419187635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ff8ac5-bc7c-404c-a5e4-c31419187635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-605819852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a007e436-4081-47cc-95a1-3059feef6e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42aa6ed1a0f5462bb353a50df08132af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:03Z,use_quota=True,user_id='6d36762d58b84467b0d446c5eaefe392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d35cf00-315b-4b9f-81c2-4a7e5213c7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d35cf00-315b-4b9f-81c2-4a7e5213c7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb71856b-a2b0-4730-82a6-d0b7b4a3fe4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb71856b-a2b0-4730-82a6-d0b7b4a3fe4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a007e436-4081-47cc-95a1-3059feef6e16', 'volume_name': 'volume-a007e436-4081-47cc-95a1-3059feef6e16', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ec219f-deb9-4bec-a309-b6e232480c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ec219f-deb9-4bec-a309-b6e232480c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796b4bc3-1dff-41d1-94b7-3ef82f85471c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:03 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Volume a007e436-4081-47cc-95a1-3059feef6e16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a007e436-4081-47cc-95a1-3059feef6e16', 'volume_size': 1} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-605819852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a007e436-4081-47cc-95a1-3059feef6e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42aa6ed1a0f5462bb353a50df08132af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:03Z,use_quota=True,user_id='6d36762d58b84467b0d446c5eaefe392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Creating volume a007e436-4081-47cc-95a1-3059feef6e16 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:07:03 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:07:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a007e436-4081-47cc-95a1-3059feef6e16 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:03 devstack sudo[98800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a007e436-4081-47cc-95a1-3059feef6e16 1073741824 Sep 17 15:07:03 devstack sudo[98800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:04 devstack sudo[98800]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a007e436-4081-47cc-95a1-3059feef6e16 1073741824" returned: 0 in 0.595s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a007e436-4081-47cc-95a1-3059feef6e16 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:04 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a007e436-4081-47cc-95a1-3059feef6e16 Sep 17 15:07:04 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:04 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a007e436-4081-47cc-95a1-3059feef6e16" returned: 0 in 0.416s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:07:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (796b4bc3-1dff-41d1-94b7-3ef82f85471c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a007e436-4081-47cc-95a1-3059feef6e16', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeecb63c-72a1-4ca6-92f6-2e431d6dd70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:04 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Volume volume-a007e436-4081-47cc-95a1-3059feef6e16 (a007e436-4081-47cc-95a1-3059feef6e16): created successfully Sep 17 15:07:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeecb63c-72a1-4ca6-92f6-2e431d6dd70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Flow 'volume_create_manager' (f3bd3d3b-e276-4ae1-9f98-c27f45eb62fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:04 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6ef4c198-e5a5-4a33-9841-528e9b24394f tempest-VolumesListAdminTestJSON-459466604 None] Created volume successfully. Sep 17 15:07:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] Acquiring lock "cinder-5da3b040-ccb2-4763-8f5e-c854cdbc639f-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] Lock "cinder-5da3b040-ccb2-4763-8f5e-c854cdbc639f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] Acquiring lock "cinder-quobyte-5da3b040-ccb2-4763-8f5e-c854cdbc639f" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] Lock "cinder-quobyte-5da3b040-ccb2-4763-8f5e-c854cdbc639f" acquired by "delete_volume" :: waited 0.036s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:05 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77124fc-3bbf-4af8-9021-3701e47f7b57]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5da3b040-ccb2-4763-8f5e-c854cdbc639f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:05 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5da3b040-ccb2-4763-8f5e-c854cdbc639f Sep 17 15:07:05 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:05 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5da3b040-ccb2-4763-8f5e-c854cdbc639f" returned: 0 in 0.523s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5da3b040-ccb2-4763-8f5e-c854cdbc639f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:05 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5da3b040-ccb2-4763-8f5e-c854cdbc639f Sep 17 15:07:05 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:05 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5da3b040-ccb2-4763-8f5e-c854cdbc639f" returned: 0 in 0.310s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] Lock "cinder-quobyte-5da3b040-ccb2-4763-8f5e-c854cdbc639f" released by "delete_volume" :: held 0.920s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:05 devstack cinder-volume[86082]: DEBUG cinder.quota [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] Created reservations ['cb8a18c5-95ec-4d90-843e-b3d4b34d4e0d', '9f8c6921-e6df-4e51-bb2f-995b97fadf81', '007c4d10-757a-4c55-94c7-1891ed47410d', '43c6c023-aeca-4778-9bc1-2bc1cc42d077'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:06 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:07:06 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:06 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.488s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.manager [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:07:06 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] Deleted volume successfully. Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Flow 'volume_create_manager' (d1fd90f6-1e2e-4f51-92b1-d2c3f4eec6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83bc6730-9af1-4955-9551-91583c82069f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-66633735-9421-4751-a82b-a9e47484030a req-2ad45c86-c573-4c5e-ba3c-2b837d4fb3e5 tempest-VolumesGetTestJSON-1718044564 None] Lock "cinder-5da3b040-ccb2-4763-8f5e-c854cdbc639f-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83bc6730-9af1-4955-9551-91583c82069f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea759ec9-dc1d-4e41-a8bc-d3f430e24975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cdf3a5e6ffe440a88713446d79b5a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:07Z,use_quota=True,user_id='3ed8bf127838455f9680d7a82232e53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4903e059-64fa-4f16-857c-0df516994205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4903e059-64fa-4f16-857c-0df516994205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9458a43f-270f-49a9-814c-97c0eef75098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9458a43f-270f-49a9-814c-97c0eef75098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea759ec9-dc1d-4e41-a8bc-d3f430e24975', 'volume_name': 'volume-ea759ec9-dc1d-4e41-a8bc-d3f430e24975', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d8c68e-b4f6-46e4-afae-08b424962bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d8c68e-b4f6-46e4-afae-08b424962bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c8c39a-d6e1-41e2-91c3-a819dcd9fadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:06 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Volume ea759ec9-dc1d-4e41-a8bc-d3f430e24975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea759ec9-dc1d-4e41-a8bc-d3f430e24975', 'volume_size': 1} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea759ec9-dc1d-4e41-a8bc-d3f430e24975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cdf3a5e6ffe440a88713446d79b5a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:07Z,use_quota=True,user_id='3ed8bf127838455f9680d7a82232e53e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Creating volume ea759ec9-dc1d-4e41-a8bc-d3f430e24975 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:07:06 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:07:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea759ec9-dc1d-4e41-a8bc-d3f430e24975 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:06 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea759ec9-dc1d-4e41-a8bc-d3f430e24975 1073741824 Sep 17 15:07:06 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:07 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea759ec9-dc1d-4e41-a8bc-d3f430e24975 1073741824" returned: 0 in 0.575s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea759ec9-dc1d-4e41-a8bc-d3f430e24975 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:07 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea759ec9-dc1d-4e41-a8bc-d3f430e24975 Sep 17 15:07:07 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Flow 'volume_create_manager' (7287f2a7-035f-43e8-9980-e2a6c725bf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266bde07-dca8-4dc8-907e-ea96ec5a62f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266bde07-dca8-4dc8-907e-ea96ec5a62f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1455167421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba43074-312b-4d03-909f-c66a20cfea69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11c82e379514d1197d7fd0964c75f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:08Z,use_quota=True,user_id='800b3eb5fcb742c9b0cb55b8a6d15f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9e0a1d-bd93-45b7-9851-ed7e4f8e6c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e9e0a1d-bd93-45b7-9851-ed7e4f8e6c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc532b56-6664-449c-bb3d-c63e51bd6c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc532b56-6664-449c-bb3d-c63e51bd6c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ba43074-312b-4d03-909f-c66a20cfea69', 'volume_name': 'volume-9ba43074-312b-4d03-909f-c66a20cfea69', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f8ad449-8216-4096-be6f-08b8dd982892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f8ad449-8216-4096-be6f-08b8dd982892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf41ba8-a95e-41ca-aaa3-c3738064657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:07 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Volume 9ba43074-312b-4d03-909f-c66a20cfea69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ba43074-312b-4d03-909f-c66a20cfea69', 'volume_size': 1} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:07 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea759ec9-dc1d-4e41-a8bc-d3f430e24975" returned: 0 in 0.398s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.017s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1455167421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba43074-312b-4d03-909f-c66a20cfea69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11c82e379514d1197d7fd0964c75f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:08Z,use_quota=True,user_id='800b3eb5fcb742c9b0cb55b8a6d15f7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Creating volume 9ba43074-312b-4d03-909f-c66a20cfea69 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:07:07 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ba43074-312b-4d03-909f-c66a20cfea69 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c8c39a-d6e1-41e2-91c3-a819dcd9fadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea759ec9-dc1d-4e41-a8bc-d3f430e24975', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:07 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ba43074-312b-4d03-909f-c66a20cfea69 1073741824 Sep 17 15:07:07 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1550400-50d1-4e99-bedc-47f16b75aace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:07 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Volume volume-ea759ec9-dc1d-4e41-a8bc-d3f430e24975 (ea759ec9-dc1d-4e41-a8bc-d3f430e24975): created successfully Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1550400-50d1-4e99-bedc-47f16b75aace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Flow 'volume_create_manager' (d1fd90f6-1e2e-4f51-92b1-d2c3f4eec6d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-59515992-26dc-4ac9-be78-feeeff17ad8a tempest-VolumesListAdminTestJSON-833024093 None] Created volume successfully. Sep 17 15:07:08 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ba43074-312b-4d03-909f-c66a20cfea69 1073741824" returned: 0 in 0.564s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ba43074-312b-4d03-909f-c66a20cfea69 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:08 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ba43074-312b-4d03-909f-c66a20cfea69 Sep 17 15:07:08 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:08 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ba43074-312b-4d03-909f-c66a20cfea69" returned: 0 in 0.300s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:07:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf41ba8-a95e-41ca-aaa3-c3738064657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ba43074-312b-4d03-909f-c66a20cfea69', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac379b97-148b-4cb0-84a1-3f613960c8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:08 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Volume volume-9ba43074-312b-4d03-909f-c66a20cfea69 (9ba43074-312b-4d03-909f-c66a20cfea69): created successfully Sep 17 15:07:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac379b97-148b-4cb0-84a1-3f613960c8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Flow 'volume_create_manager' (7287f2a7-035f-43e8-9980-e2a6c725bf80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:08 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c5d339b6-447e-422b-aaa5-89e2d43d5f01 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Created volume successfully. Sep 17 15:07:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] Acquiring lock "cinder-ea759ec9-dc1d-4e41-a8bc-d3f430e24975-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] Lock "cinder-ea759ec9-dc1d-4e41-a8bc-d3f430e24975-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] Acquiring lock "cinder-quobyte-ea759ec9-dc1d-4e41-a8bc-d3f430e24975" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] Lock "cinder-quobyte-ea759ec9-dc1d-4e41-a8bc-d3f430e24975" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:09 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[449bd959-3578-44f8-a8d7-37582af2f3fb]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea759ec9-dc1d-4e41-a8bc-d3f430e24975 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] Acquiring lock "cinder-a007e436-4081-47cc-95a1-3059feef6e16-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] Lock "cinder-a007e436-4081-47cc-95a1-3059feef6e16-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] Acquiring lock "cinder-quobyte-a007e436-4081-47cc-95a1-3059feef6e16" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] Lock "cinder-quobyte-a007e436-4081-47cc-95a1-3059feef6e16" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:09 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa714db0-4923-470e-ae40-3b6615c2d447]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a007e436-4081-47cc-95a1-3059feef6e16 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:09 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea759ec9-dc1d-4e41-a8bc-d3f430e24975 Sep 17 15:07:09 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:09 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a007e436-4081-47cc-95a1-3059feef6e16 Sep 17 15:07:09 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:09 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Flow 'volume_create_manager' (ef245b55-3cd3-4ea3-8038-0bd7f77bd0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ee2ebd-cc8a-4e61-9bcb-5fc6d836bfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:10 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a007e436-4081-47cc-95a1-3059feef6e16" returned: 0 in 0.659s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a007e436-4081-47cc-95a1-3059feef6e16 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:10 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ee2ebd-cc8a-4e61-9bcb-5fc6d836bfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-897953042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1065d52-b822-46a4-9e68-9af3f43204c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41939674ff34c0c8f79a84738a94380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:10Z,use_quota=True,user_id='5e9e8a0c8cc547e5bb2fe915a8abe7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c854301e-96b9-4e46-8133-1c6992ac01af),volume_type_id=c854301e-96b9-4e46-8133-1c6992ac01af)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1155b29-69d7-47b0-9cc5-d0435d2538e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1155b29-69d7-47b0-9cc5-d0435d2538e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:10 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a007e436-4081-47cc-95a1-3059feef6e16 Sep 17 15:07:10 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8ee792-5a15-47ce-93dc-b88559815a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8ee792-5a15-47ce-93dc-b88559815a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1065d52-b822-46a4-9e68-9af3f43204c7', 'volume_name': 'volume-c1065d52-b822-46a4-9e68-9af3f43204c7', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43922bad-ed00-4882-83a3-d74f721ff901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43922bad-ed00-4882-83a3-d74f721ff901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ae84b3-dae6-4436-8de4-67ad5cf75313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:10 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Volume c1065d52-b822-46a4-9e68-9af3f43204c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1065d52-b822-46a4-9e68-9af3f43204c7', 'volume_size': 1} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-897953042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1065d52-b822-46a4-9e68-9af3f43204c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41939674ff34c0c8f79a84738a94380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:10Z,use_quota=True,user_id='5e9e8a0c8cc547e5bb2fe915a8abe7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c854301e-96b9-4e46-8133-1c6992ac01af),volume_type_id=c854301e-96b9-4e46-8133-1c6992ac01af)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Creating volume c1065d52-b822-46a4-9e68-9af3f43204c7 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:07:10 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c1065d52-b822-46a4-9e68-9af3f43204c7 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea759ec9-dc1d-4e41-a8bc-d3f430e24975" returned: 0 in 1.030s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea759ec9-dc1d-4e41-a8bc-d3f430e24975 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:10 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c1065d52-b822-46a4-9e68-9af3f43204c7 1073741824 Sep 17 15:07:10 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:10 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea759ec9-dc1d-4e41-a8bc-d3f430e24975 Sep 17 15:07:10 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:10 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a007e436-4081-47cc-95a1-3059feef6e16" returned: 0 in 0.416s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] Lock "cinder-quobyte-a007e436-4081-47cc-95a1-3059feef6e16" released by "delete_volume" :: held 1.173s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] Created reservations ['b1c47938-eaa3-4727-9081-6d430cc55dee', '78f3a948-bb72-4b4e-b158-55c87ca887bb', '81402b59-7dc4-4e2e-b4b4-678ec1520971', '7369215e-2b54-4578-a692-5edffffde75f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:07:10 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea759ec9-dc1d-4e41-a8bc-d3f430e24975" returned: 0 in 0.551s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] Lock "cinder-quobyte-ea759ec9-dc1d-4e41-a8bc-d3f430e24975" released by "delete_volume" :: held 1.687s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Flow 'volume_create_manager' (22bf5668-5b34-45a8-8c40-a05ec36bb1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f7bcfc-048c-424c-a8a0-c7c70aed9f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f7bcfc-048c-424c-a8a0-c7c70aed9f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-676519242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d63450b-6ad9-4503-bfed-5357d44b46af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41939674ff34c0c8f79a84738a94380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:11Z,use_quota=True,user_id='5e9e8a0c8cc547e5bb2fe915a8abe7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7a6edb7-53e6-4b0f-aabd-479a14360c4b),volume_type_id=d7a6edb7-53e6-4b0f-aabd-479a14360c4b)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57cdf4b5-584a-462b-823a-4da86a869d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57cdf4b5-584a-462b-823a-4da86a869d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5beedb-535d-4141-8334-afcd7bb78bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5beedb-535d-4141-8334-afcd7bb78bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d63450b-6ad9-4503-bfed-5357d44b46af', 'volume_name': 'volume-1d63450b-6ad9-4503-bfed-5357d44b46af', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99883e9-b09a-4b2d-b6d2-7dd7d13986b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e99883e9-b09a-4b2d-b6d2-7dd7d13986b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0c143b-f2ad-4398-a27c-36f40ecc12ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:10 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Volume 1d63450b-6ad9-4503-bfed-5357d44b46af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d63450b-6ad9-4503-bfed-5357d44b46af', 'volume_size': 1} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] Created reservations ['d328b641-c646-48b1-83e5-93fe420f1c68', 'df4470ab-1ff4-495e-94cf-a92bcc4f9dd5', '1e5212f6-d007-4567-b3c1-9533b0ba2a8e', '5a6801ec-5f22-4f70-9790-343d292ab9cf'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:07:11 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c1065d52-b822-46a4-9e68-9af3f43204c7 1073741824" returned: 0 in 0.908s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:11 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:07:11 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c1065d52-b822-46a4-9e68-9af3f43204c7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:11 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c1065d52-b822-46a4-9e68-9af3f43204c7 Sep 17 15:07:11 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-6906a5b8-d22e-4b1e-82d4-d4e758d78846 req-35fd67eb-f62c-4a44-b6d9-60805368faeb tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:11 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:07:11 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:11 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.516s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:07:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] Deleted volume successfully. Sep 17 15:07:11 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.329s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:07:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] Deleted volume successfully. Sep 17 15:07:11 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-85da6fe4-ef71-44af-9591-c565baa9e54d tempest-VolumesListAdminTestJSON-459466604 None] Lock "cinder-a007e436-4081-47cc-95a1-3059feef6e16-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c1065d52-b822-46a4-9e68-9af3f43204c7" returned: 0 in 0.446s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-237d69fd-0c0d-4673-8a46-753ed93f6e5d tempest-VolumesListAdminTestJSON-833024093 None] Lock "cinder-ea759ec9-dc1d-4e41-a8bc-d3f430e24975-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.620s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-676519242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d63450b-6ad9-4503-bfed-5357d44b46af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41939674ff34c0c8f79a84738a94380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:11Z,use_quota=True,user_id='5e9e8a0c8cc547e5bb2fe915a8abe7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7a6edb7-53e6-4b0f-aabd-479a14360c4b),volume_type_id=d7a6edb7-53e6-4b0f-aabd-479a14360c4b)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Creating volume 1d63450b-6ad9-4503-bfed-5357d44b46af {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:07:11 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d63450b-6ad9-4503-bfed-5357d44b46af 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:11 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d63450b-6ad9-4503-bfed-5357d44b46af 1073741824 Sep 17 15:07:11 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ae84b3-dae6-4436-8de4-67ad5cf75313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1065d52-b822-46a4-9e68-9af3f43204c7', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaba9d5b-d283-4b8c-bf6a-8760307d869d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:11 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Volume volume-c1065d52-b822-46a4-9e68-9af3f43204c7 (c1065d52-b822-46a4-9e68-9af3f43204c7): created successfully Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaba9d5b-d283-4b8c-bf6a-8760307d869d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Flow 'volume_create_manager' (ef245b55-3cd3-4ea3-8038-0bd7f77bd0cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] Acquiring lock "cinder-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Flow 'volume_create_manager' (97fa3610-9786-4fb0-86df-8d472ec3893b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6b7d53-1569-46c4-8495-0bb685888f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-50cf9412-2db2-4992-ac4a-443c3a0b99c4 tempest-TestInstancesWithCinderVolumes-1537908 None] Created volume successfully. Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6b7d53-1569-46c4-8495-0bb685888f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1935465024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31996447-9f16-4a62-a279-a5d6243690d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41939674ff34c0c8f79a84738a94380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:12Z,use_quota=True,user_id='5e9e8a0c8cc547e5bb2fe915a8abe7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2f6f03e-c663-4be3-bef9-9d2d7fa4fc43),volume_type_id=d2f6f03e-c663-4be3-bef9-9d2d7fa4fc43)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5256c3-cc51-412d-be8e-592a58addbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5256c3-cc51-412d-be8e-592a58addbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe4768f-4cbe-4a95-95f6-60c94cd844bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] Lock "cinder-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] Acquiring lock "cinder-quobyte-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] Lock "cinder-quobyte-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc78d8b-6a1a-4dd4-9eeb-5063f769ca48]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:12 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff Sep 17 15:07:12 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:12 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d63450b-6ad9-4503-bfed-5357d44b46af 1073741824" returned: 0 in 0.560s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d63450b-6ad9-4503-bfed-5357d44b46af {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:12 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d63450b-6ad9-4503-bfed-5357d44b46af Sep 17 15:07:12 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe4768f-4cbe-4a95-95f6-60c94cd844bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '31996447-9f16-4a62-a279-a5d6243690d0', 'volume_name': 'volume-31996447-9f16-4a62-a279-a5d6243690d0', 'volume_size': 1, 'image_id': '8eaf066c-536e-4166-a7fe-a4b58f293562', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8eaf066c-536e-4166-a7fe-a4b58f293562', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1545376632', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b41939674ff34c0c8f79a84738a94380', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8eaf066c-536e-4166-a7fe-a4b58f293562', 'created_at': datetime.datetime(2026, 9, 17, 13, 7, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 7, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8eaf066c-536e-4166-a7fe-a4b58f293562/file', 'properties': {}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c862ff-6fd4-40e8-ad6d-dad4e8c7dd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c862ff-6fd4-40e8-ad6d-dad4e8c7dd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670b9f7c-df58-4b25-b25c-01f297e87315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:12 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Volume 31996447-9f16-4a62-a279-a5d6243690d0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-31996447-9f16-4a62-a279-a5d6243690d0', 'volume_size': 1, 'image_id': '8eaf066c-536e-4166-a7fe-a4b58f293562', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8eaf066c-536e-4166-a7fe-a4b58f293562', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1545376632', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b41939674ff34c0c8f79a84738a94380', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8eaf066c-536e-4166-a7fe-a4b58f293562', 'created_at': datetime.datetime(2026, 9, 17, 13, 7, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 7, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8eaf066c-536e-4166-a7fe-a4b58f293562/file', 'properties': {}}, 'image_service': } Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Trying to clone 31996447-9f16-4a62-a279-a5d6243690d0 from image 8eaf066c-536e-4166-a7fe-a4b58f293562 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8eaf066c-536e-4166-a7fe-a4b58f293562', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:07:12 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff" returned: 0 in 0.501s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:12 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff Sep 17 15:07:12 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:12 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d63450b-6ad9-4503-bfed-5357d44b46af" returned: 0 in 0.337s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-6906a5b8-d22e-4b1e-82d4-d4e758d78846 req-35fd67eb-f62c-4a44-b6d9-60805368faeb tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.361s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-6906a5b8-d22e-4b1e-82d4-d4e758d78846 req-35fd67eb-f62c-4a44-b6d9-60805368faeb tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0c143b-f2ad-4398-a27c-36f40ecc12ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d63450b-6ad9-4503-bfed-5357d44b46af', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e1f2c3-3d8c-456a-af7d-4ede27fd7308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:12 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Volume volume-1d63450b-6ad9-4503-bfed-5357d44b46af (1d63450b-6ad9-4503-bfed-5357d44b46af): created successfully Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9e1f2c3-3d8c-456a-af7d-4ede27fd7308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Flow 'volume_create_manager' (22bf5668-5b34-45a8-8c40-a05ec36bb1d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:12 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9df1026b-abe7-405f-8907-e1f5b17167fe tempest-TestInstancesWithCinderVolumes-1537908 None] Created volume successfully. Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-6906a5b8-d22e-4b1e-82d4-d4e758d78846 req-35fd67eb-f62c-4a44-b6d9-60805368faeb tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-9ba43074-312b-4d03-909f-c66a20cfea69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17b178d1-94dd-475d-956c-90846c3015f2', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:07:12 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-6906a5b8-d22e-4b1e-82d4-d4e758d78846 req-35fd67eb-f62c-4a44-b6d9-60805368faeb tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] attachment_update completed successfully. Sep 17 15:07:12 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff" returned: 0 in 0.342s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] Lock "cinder-quobyte-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff" released by "delete_volume" :: held 0.908s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:12 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] Created reservations ['9c3d7336-faad-4012-8630-651b4745a0c9', '36f3ba68-a0d1-4772-8cb7-1cc85890d29b', '32f4fca4-5b62-4a53-b60b-26385f0f710f', '87cd3297-57a1-403a-b658-2727b09c6db2'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:07:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:13 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:07:13 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] Acquiring lock "cinder-04d52c85-8608-4f89-8880-412f3251ef85-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] Lock "cinder-04d52c85-8608-4f89-8880-412f3251ef85-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] Acquiring lock "cinder-quobyte-04d52c85-8608-4f89-8880-412f3251ef85" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] Lock "cinder-quobyte-04d52c85-8608-4f89-8880-412f3251ef85" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:13 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[440b426f-09b5-4a12-8b5e-cef7c1b4a0ae]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-04d52c85-8608-4f89-8880-412f3251ef85 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:13 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.371s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:13 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:07:13 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] Deleted volume successfully. Sep 17 15:07:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-38481d90-5024-45d8-818c-1439ee75d6a2 tempest-VolumesListAdminTestJSON-459466604 None] Lock "cinder-4ea0927f-7cfd-4c73-95c8-a8a0eafaebff-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:13 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-04d52c85-8608-4f89-8880-412f3251ef85 Sep 17 15:07:13 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:13 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-04d52c85-8608-4f89-8880-412f3251ef85" returned: 0 in 0.568s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-04d52c85-8608-4f89-8880-412f3251ef85 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:13 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-04d52c85-8608-4f89-8880-412f3251ef85 Sep 17 15:07:13 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:14 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-04d52c85-8608-4f89-8880-412f3251ef85" returned: 0 in 0.382s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] Lock "cinder-quobyte-04d52c85-8608-4f89-8880-412f3251ef85" released by "delete_volume" :: held 1.029s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:14 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] Created reservations ['32fd8d89-a1f0-4183-9df7-adbdc6872928', '23bb7c88-0063-4009-b156-c6625b4187f0', '55f78597-777d-4096-a9ad-13f33b9a04d6', '1b4fad1b-7372-4940-a9b2-f6e1dd096580'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:07:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:14 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:07:14 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:14 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.294s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:14 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:07:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] Deleted volume successfully. Sep 17 15:07:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-61d1384c-9d50-4fef-af70-33d97573d5ef tempest-VolumesListAdminTestJSON-459466604 None] Lock "cinder-04d52c85-8608-4f89-8880-412f3251ef85-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:16 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-4499eff1-0ffe-455e-b419-d5157cecc3eb req-cf095cf2-b551-4d09-a45e-7448f9b38ee2 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Terminate volume connection completed successfully. Sep 17 15:07:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-4499eff1-0ffe-455e-b419-d5157cecc3eb req-cf095cf2-b551-4d09-a45e-7448f9b38ee2 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Deleting attachment 17b178d1-94dd-475d-956c-90846c3015f2. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:07:17 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8eaf066c-536e-4166-a7fe-a4b58f293562_earbjhhxdevstack@QuobyteHD, size 20.69 MB, duration 4.96 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 15:07:17 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Image download 20.69 MB at 4.17 MB/s Sep 17 15:07:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Acquiring lock "cinder-9ba43074-312b-4d03-909f-c66a20cfea69-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:17 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[61524a58-9ebb-4057-9c15-6e659d81f473]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8eaf066c-536e-4166-a7fe-a4b58f293562_earbjhhxdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Lock "cinder-9ba43074-312b-4d03-909f-c66a20cfea69-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Acquiring lock "cinder-quobyte-9ba43074-312b-4d03-909f-c66a20cfea69" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Lock "cinder-quobyte-9ba43074-312b-4d03-909f-c66a20cfea69" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:17 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b5fff0-a9a3-485a-b61b-7880ef234987]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ba43074-312b-4d03-909f-c66a20cfea69 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:17 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8eaf066c-536e-4166-a7fe-a4b58f293562_earbjhhxdevstack@QuobyteHD Sep 17 15:07:17 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:17 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ba43074-312b-4d03-909f-c66a20cfea69 Sep 17 15:07:17 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:17 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8eaf066c-536e-4166-a7fe-a4b58f293562_earbjhhxdevstack@QuobyteHD" returned: 0 in 0.506s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:17 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Temporary image 8eaf066c-536e-4166-a7fe-a4b58f293562 is fetched for user 5e9e8a0c8cc547e5bb2fe915a8abe7e2. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 15:07:17 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fbbe1e-01e9-4dc7-b990-b9befffcd95d]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8eaf066c-536e-4166-a7fe-a4b58f293562_earbjhhxdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:17 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ba43074-312b-4d03-909f-c66a20cfea69" returned: 0 in 0.529s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ba43074-312b-4d03-909f-c66a20cfea69 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:18 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ba43074-312b-4d03-909f-c66a20cfea69 Sep 17 15:07:18 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:18 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8eaf066c-536e-4166-a7fe-a4b58f293562_earbjhhxdevstack@QuobyteHD Sep 17 15:07:18 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:18 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8eaf066c-536e-4166-a7fe-a4b58f293562_earbjhhxdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1935465024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31996447-9f16-4a62-a279-a5d6243690d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41939674ff34c0c8f79a84738a94380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:12Z,use_quota=True,user_id='5e9e8a0c8cc547e5bb2fe915a8abe7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2f6f03e-c663-4be3-bef9-9d2d7fa4fc43),volume_type_id=d2f6f03e-c663-4be3-bef9-9d2d7fa4fc43)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Creating volume 31996447-9f16-4a62-a279-a5d6243690d0 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:07:18 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:18 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0 1073741824 Sep 17 15:07:18 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:18 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9ba43074-312b-4d03-909f-c66a20cfea69" returned: 0 in 0.406s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Lock "cinder-quobyte-9ba43074-312b-4d03-909f-c66a20cfea69" released by "delete_volume" :: held 1.006s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Created reservations ['a5f12e5d-a7a7-4912-842a-795ef953408f', '3552a0cf-98f5-4769-9aff-fd4837c33452', 'c317b4c2-e709-48f9-b7e6-958e1986afba', '496a9d52-6ec4-4187-9e35-84a3148f39d1'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:18 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:07:18 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:18 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0 1073741824" returned: 0 in 0.581s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:18 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.344s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:18 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:07:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Deleted volume successfully. Sep 17 15:07:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cddf50ac-4f31-45f8-9bca-1d3aec898a88 tempest-TestServerVolumeAttachScenarioOldVersion-1273903399 None] Lock "cinder-9ba43074-312b-4d03-909f-c66a20cfea69-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:19 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0 Sep 17 15:07:19 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:19 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0" returned: 0 in 0.291s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:07:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:19 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Attempting download of 8eaf066c-536e-4166-a7fe-a4b58f293562 ((None, [{'url': 'file:///opt/stack/data/glance/images/8eaf066c-536e-4166-a7fe-a4b58f293562', 'metadata': {}}])) to volume 31996447-9f16-4a62-a279-a5d6243690d0. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:07:19 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[570d95de-3c62-4443-8ffb-3e415ffe9d53]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8eaf066c-536e-4166-a7fe-a4b58f293562_wnzq50tc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:19 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8eaf066c-536e-4166-a7fe-a4b58f293562_wnzq50tc Sep 17 15:07:19 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:19 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8eaf066c-536e-4166-a7fe-a4b58f293562_wnzq50tc" returned: 0 in 0.371s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8eaf066c-536e-4166-a7fe-a4b58f293562_wnzq50tc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:19 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8eaf066c-536e-4166-a7fe-a4b58f293562_wnzq50tc Sep 17 15:07:19 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:20 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8eaf066c-536e-4166-a7fe-a4b58f293562_wnzq50tc" returned: 1 in 0.422s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8eaf066c-536e-4166-a7fe-a4b58f293562_wnzq50tc' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:07:20 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ead5cf-5578-4524-8519-4a5065523324]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8eaf066c-536e-4166-a7fe-a4b58f293562_earbjhhxdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:20 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8eaf066c-536e-4166-a7fe-a4b58f293562_earbjhhxdevstack@QuobyteHD Sep 17 15:07:20 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:20 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8eaf066c-536e-4166-a7fe-a4b58f293562_earbjhhxdevstack@QuobyteHD" returned: 0 in 0.656s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:20 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] 8eaf066c-536e-4166-a7fe-a4b58f293562 was qcow2, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 15:07:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8eaf066c-536e-4166-a7fe-a4b58f293562_earbjhhxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:20 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8eaf066c-536e-4166-a7fe-a4b58f293562_earbjhhxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0 Sep 17 15:07:20 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:23 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8eaf066c-536e-4166-a7fe-a4b58f293562_earbjhhxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0" returned: 0 in 2.761s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:23 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8eaf066c-536e-4166-a7fe-a4b58f293562_earbjhhxdevstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:07:23 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Converted 112.00 MB image at 40.54 MB/s Sep 17 15:07:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:23 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0 1G Sep 17 15:07:23 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:24 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0 1G" returned: 0 in 0.392s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:24 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Downloaded image 8eaf066c-536e-4166-a7fe-a4b58f293562 ((None, [{'url': 'file:///opt/stack/data/glance/images/8eaf066c-536e-4166-a7fe-a4b58f293562', 'metadata': {}}])) to volume 31996447-9f16-4a62-a279-a5d6243690d0 successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:07:24 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Temporary image 8eaf066c-536e-4166-a7fe-a4b58f293562 for user 5e9e8a0c8cc547e5bb2fe915a8abe7e2 is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 15:07:24 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Marking volume 31996447-9f16-4a62-a279-a5d6243690d0 as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:07:24 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Copying metadata from image 8eaf066c-536e-4166-a7fe-a4b58f293562 to 31996447-9f16-4a62-a279-a5d6243690d0. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:07:24 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Creating volume glance metadata for volume 31996447-9f16-4a62-a279-a5d6243690d0 backed by image 8eaf066c-536e-4166-a7fe-a4b58f293562 with: {'image_id': '8eaf066c-536e-4166-a7fe-a4b58f293562', 'image_name': 'tempest-scenario-img--1545376632', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:07:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670b9f7c-df58-4b25-b25c-01f297e87315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31996447-9f16-4a62-a279-a5d6243690d0', 'volume_size': 1, 'image_id': '8eaf066c-536e-4166-a7fe-a4b58f293562', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8eaf066c-536e-4166-a7fe-a4b58f293562', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1545376632', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b41939674ff34c0c8f79a84738a94380', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8eaf066c-536e-4166-a7fe-a4b58f293562', 'created_at': datetime.datetime(2026, 9, 17, 13, 7, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 7, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8eaf066c-536e-4166-a7fe-a4b58f293562/file', 'properties': {}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b515836f-788e-4c45-8236-7e4000eb50da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:24 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Volume volume-31996447-9f16-4a62-a279-a5d6243690d0 (31996447-9f16-4a62-a279-a5d6243690d0): created successfully Sep 17 15:07:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b515836f-788e-4c45-8236-7e4000eb50da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Flow 'volume_create_manager' (97fa3610-9786-4fb0-86df-8d472ec3893b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:24 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-431b905b-f497-4b90-827d-ac669b5f8e9f tempest-TestInstancesWithCinderVolumes-1537908 None] Created volume successfully. Sep 17 15:07:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-72e29f8b-3033-44c9-a8a5-4777e6010ea6 req-58254ad6-9c7f-464b-a6de-d7105c5bf4ad tempest-TestInstancesWithCinderVolumes-1537908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-72e29f8b-3033-44c9-a8a5-4777e6010ea6 req-58254ad6-9c7f-464b-a6de-d7105c5bf4ad tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-72e29f8b-3033-44c9-a8a5-4777e6010ea6 req-58254ad6-9c7f-464b-a6de-d7105c5bf4ad tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-72e29f8b-3033-44c9-a8a5-4777e6010ea6 req-58254ad6-9c7f-464b-a6de-d7105c5bf4ad tempest-TestInstancesWithCinderVolumes-1537908 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-31996447-9f16-4a62-a279-a5d6243690d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e3857ac-2a8f-485c-af63-7597f88850ef', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:07:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-72e29f8b-3033-44c9-a8a5-4777e6010ea6 req-58254ad6-9c7f-464b-a6de-d7105c5bf4ad tempest-TestInstancesWithCinderVolumes-1537908 None] attachment_update completed successfully. Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Flow 'volume_create_manager' (79df6dd6-993b-458a-a3e2-f453ddde3ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd05d12-6793-4013-b793-ee6cd8ba04f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd05d12-6793-4013-b793-ee6cd8ba04f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-101878539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba900aaf-a898-4db4-ba12-69b3ab50882b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d991141f834aa3b867a65677e9f03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:31Z,use_quota=True,user_id='7cf67979b68648b8b4d31def339a57f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ac6f8e-f4ed-411e-a317-2ded4068966d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ac6f8e-f4ed-411e-a317-2ded4068966d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078538dc-c6b1-4af0-ac91-1813dd09e5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078538dc-c6b1-4af0-ac91-1813dd09e5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba900aaf-a898-4db4-ba12-69b3ab50882b', 'volume_name': 'volume-ba900aaf-a898-4db4-ba12-69b3ab50882b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c72510c-8919-416b-816f-20d01cd47182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c72510c-8919-416b-816f-20d01cd47182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8b6f16-5a48-4a23-acf7-f257ed65b947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:30 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Volume ba900aaf-a898-4db4-ba12-69b3ab50882b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba900aaf-a898-4db4-ba12-69b3ab50882b', 'volume_size': 1} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-101878539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba900aaf-a898-4db4-ba12-69b3ab50882b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d991141f834aa3b867a65677e9f03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:31Z,use_quota=True,user_id='7cf67979b68648b8b4d31def339a57f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Creating volume ba900aaf-a898-4db4-ba12-69b3ab50882b {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:07:30 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:07:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ba900aaf-a898-4db4-ba12-69b3ab50882b 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:31 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ba900aaf-a898-4db4-ba12-69b3ab50882b 1073741824 Sep 17 15:07:31 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:31 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ba900aaf-a898-4db4-ba12-69b3ab50882b 1073741824" returned: 0 in 0.677s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ba900aaf-a898-4db4-ba12-69b3ab50882b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:31 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ba900aaf-a898-4db4-ba12-69b3ab50882b Sep 17 15:07:31 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:32 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ba900aaf-a898-4db4-ba12-69b3ab50882b" returned: 0 in 0.377s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:07:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd8b6f16-5a48-4a23-acf7-f257ed65b947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba900aaf-a898-4db4-ba12-69b3ab50882b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0c97b0-62da-4e1b-9dae-df04992a9c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:32 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Volume volume-ba900aaf-a898-4db4-ba12-69b3ab50882b (ba900aaf-a898-4db4-ba12-69b3ab50882b): created successfully Sep 17 15:07:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d0c97b0-62da-4e1b-9dae-df04992a9c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Flow 'volume_create_manager' (79df6dd6-993b-458a-a3e2-f453ddde3ef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:32 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-96165298-43e7-4c94-897c-e8393cbf744a tempest-VolumeQuotasAdminTestJSON-787867162 None] Created volume successfully. Sep 17 15:07:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] Acquiring lock "cinder-ba900aaf-a898-4db4-ba12-69b3ab50882b-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] Lock "cinder-ba900aaf-a898-4db4-ba12-69b3ab50882b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] Acquiring lock "cinder-quobyte-ba900aaf-a898-4db4-ba12-69b3ab50882b" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] Lock "cinder-quobyte-ba900aaf-a898-4db4-ba12-69b3ab50882b" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:33 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8c702f-5717-4aa1-9ae0-8e43ba363071]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ba900aaf-a898-4db4-ba12-69b3ab50882b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:33 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ba900aaf-a898-4db4-ba12-69b3ab50882b Sep 17 15:07:33 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:34 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ba900aaf-a898-4db4-ba12-69b3ab50882b" returned: 0 in 0.721s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ba900aaf-a898-4db4-ba12-69b3ab50882b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:34 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ba900aaf-a898-4db4-ba12-69b3ab50882b Sep 17 15:07:34 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:34 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ba900aaf-a898-4db4-ba12-69b3ab50882b" returned: 0 in 0.428s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] Lock "cinder-quobyte-ba900aaf-a898-4db4-ba12-69b3ab50882b" released by "delete_volume" :: held 1.231s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Flow 'volume_create_manager' (55714723-9673-401e-8971-fe4688461f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07a2504-cd5b-401b-a0f6-944e4a45ac8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07a2504-cd5b-401b-a0f6-944e4a45ac8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1659318766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2c3944-0aa5-4758-b4ba-f7fc05a7a595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ad41020b3c24c91aebfde1393b1ddd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:34Z,use_quota=True,user_id='f0804f3a92b145ee8d4f0e3ad1588733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c746d95-e5f9-41ac-9db9-7a1572d8cc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c746d95-e5f9-41ac-9db9-7a1572d8cc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79d6844-2a7e-48e8-b6b8-465d20477ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a79d6844-2a7e-48e8-b6b8-465d20477ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e2c3944-0aa5-4758-b4ba-f7fc05a7a595', 'volume_name': 'volume-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900d1cd3-8c8e-48ab-aa22-49567b6f494f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900d1cd3-8c8e-48ab-aa22-49567b6f494f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b081d482-6b23-4820-bb14-e6ee507fc1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:34 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Volume 6e2c3944-0aa5-4758-b4ba-f7fc05a7a595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595', 'volume_size': 1} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1659318766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2c3944-0aa5-4758-b4ba-f7fc05a7a595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ad41020b3c24c91aebfde1393b1ddd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:34Z,use_quota=True,user_id='f0804f3a92b145ee8d4f0e3ad1588733',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Creating volume 6e2c3944-0aa5-4758-b4ba-f7fc05a7a595 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:07:34 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] Created reservations ['1e4458ec-6702-4e6f-ada1-e25ceef8d875', '240c510c-002a-4c03-9329-952ce69d2a5c', '977cfd94-688f-4530-ae93-6846fd2eca12', '2d51c95d-d0d1-49b8-8e0d-f016cd66022e'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:07:34 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595 1073741824 Sep 17 15:07:34 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:34 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:07:34 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:35 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.386s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:35 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:07:35 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] Deleted volume successfully. Sep 17 15:07:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1d2fb699-ba08-4c5b-acf5-dae9bdd358c1 tempest-VolumeQuotasAdminTestJSON-787867162 None] Lock "cinder-ba900aaf-a898-4db4-ba12-69b3ab50882b-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:35 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595 1073741824" returned: 0 in 0.752s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:35 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595 Sep 17 15:07:35 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:36 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595" returned: 0 in 0.396s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b081d482-6b23-4820-bb14-e6ee507fc1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8860bd89-0970-42e4-a195-1e7700070a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:36 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Volume volume-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595 (6e2c3944-0aa5-4758-b4ba-f7fc05a7a595): created successfully Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8860bd89-0970-42e4-a195-1e7700070a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Flow 'volume_create_manager' (55714723-9673-401e-8971-fe4688461f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:36 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-45ad2704-6954-425e-a3d9-ab82707cd9dd tempest-AbsoluteLimitsTests-1087646845 None] Created volume successfully. Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Flow 'volume_create_manager' (c56141f1-5741-4716-bed1-606f854b3259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40acfae7-98cc-4faa-98fc-98f1479d32ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40acfae7-98cc-4faa-98fc-98f1479d32ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1766008359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8742acd9-9cf3-43f7-a098-d540695ff154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d991141f834aa3b867a65677e9f03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:36Z,use_quota=True,user_id='7cf67979b68648b8b4d31def339a57f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414fbaa1-8cf4-40b6-95ea-68e7827514a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (414fbaa1-8cf4-40b6-95ea-68e7827514a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5f8c57-3f01-47b7-93e7-434dad17e89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5f8c57-3f01-47b7-93e7-434dad17e89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8742acd9-9cf3-43f7-a098-d540695ff154', 'volume_name': 'volume-8742acd9-9cf3-43f7-a098-d540695ff154', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f94280f-fb7a-489b-8dd9-83dbc781c68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f94280f-fb7a-489b-8dd9-83dbc781c68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3a1698-ec16-4c05-aa5c-b4eceaca7288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:36 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Volume 8742acd9-9cf3-43f7-a098-d540695ff154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8742acd9-9cf3-43f7-a098-d540695ff154', 'volume_size': 1} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1766008359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8742acd9-9cf3-43f7-a098-d540695ff154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d991141f834aa3b867a65677e9f03b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:36Z,use_quota=True,user_id='7cf67979b68648b8b4d31def339a57f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Creating volume 8742acd9-9cf3-43f7-a098-d540695ff154 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:07:36 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:07:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8742acd9-9cf3-43f7-a098-d540695ff154 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:36 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8742acd9-9cf3-43f7-a098-d540695ff154 1073741824 Sep 17 15:07:36 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] Acquiring lock "cinder-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] Lock "cinder-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] Acquiring lock "cinder-quobyte-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] Lock "cinder-quobyte-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:37 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d75505a-f126-45e4-8223-6aa9bc8793ff]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:37 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8742acd9-9cf3-43f7-a098-d540695ff154 1073741824" returned: 0 in 1.047s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8742acd9-9cf3-43f7-a098-d540695ff154 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:37 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595 Sep 17 15:07:37 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:37 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8742acd9-9cf3-43f7-a098-d540695ff154 Sep 17 15:07:37 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:38 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595" returned: 0 in 0.666s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:38 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8742acd9-9cf3-43f7-a098-d540695ff154" returned: 0 in 0.526s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:07:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:38 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595 Sep 17 15:07:38 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3a1698-ec16-4c05-aa5c-b4eceaca7288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8742acd9-9cf3-43f7-a098-d540695ff154', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ba02f2-3b92-4493-8fc4-9e7728fca684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:38 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Volume volume-8742acd9-9cf3-43f7-a098-d540695ff154 (8742acd9-9cf3-43f7-a098-d540695ff154): created successfully Sep 17 15:07:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ba02f2-3b92-4493-8fc4-9e7728fca684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Flow 'volume_create_manager' (c56141f1-5741-4716-bed1-606f854b3259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:38 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f22076f9-357e-484f-861e-25e8d396fcc6 tempest-VolumeQuotasAdminTestJSON-787867162 None] Created volume successfully. Sep 17 15:07:38 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595" returned: 0 in 0.711s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] Lock "cinder-quobyte-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595" released by "delete_volume" :: held 1.471s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:39 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] Created reservations ['bd57cb5c-2807-4844-80d5-ffcb33400200', '7b95a30f-5e46-4520-8e43-440b2d631658', '658e67df-b1be-41e5-ba82-eae16c35a7ef', 'b6ac4116-51a9-4f66-9a59-8a7531796233'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:07:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:39 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:07:39 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:39 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.627s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:39 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:07:39 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] Deleted volume successfully. Sep 17 15:07:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c8f3858c-a293-471c-ad65-8421f46f0493 tempest-AbsoluteLimitsTests-1087646845 None] Lock "cinder-6e2c3944-0aa5-4758-b4ba-f7fc05a7a595-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:07:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:40 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:07:40 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:40 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2981e30a-05ef-4af5-8a50-57f951d2135d tempest-VolumeQuotasAdminTestJSON-415296620 None] Transfer volume completed successfully. Sep 17 15:07:40 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.527s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:07:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:07:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:07:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:07:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] Acquiring lock "cinder-8742acd9-9cf3-43f7-a098-d540695ff154-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] Lock "cinder-8742acd9-9cf3-43f7-a098-d540695ff154-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] Acquiring lock "cinder-quobyte-8742acd9-9cf3-43f7-a098-d540695ff154" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] Lock "cinder-quobyte-8742acd9-9cf3-43f7-a098-d540695ff154" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:41 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c2e0e5-b741-4460-9062-f34d3aa9d27e]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8742acd9-9cf3-43f7-a098-d540695ff154 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:42 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8742acd9-9cf3-43f7-a098-d540695ff154 Sep 17 15:07:42 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:42 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8742acd9-9cf3-43f7-a098-d540695ff154" returned: 0 in 0.688s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8742acd9-9cf3-43f7-a098-d540695ff154 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:42 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8742acd9-9cf3-43f7-a098-d540695ff154 Sep 17 15:07:42 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:43 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8742acd9-9cf3-43f7-a098-d540695ff154" returned: 0 in 0.472s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] Lock "cinder-quobyte-8742acd9-9cf3-43f7-a098-d540695ff154" released by "delete_volume" :: held 1.223s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:43 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] Created reservations ['d6c99166-b46f-4440-a15e-7eaaa81a4089', 'd0cf49ec-5f66-4d93-927f-1a067adb2184', '17ec1e55-45d0-435b-9b85-f0a0a599efcf', 'abf2f047-d71c-4d99-a17c-9adf73d692e9'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:07:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:43 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:07:43 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:44 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.654s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:44 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:07:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] Deleted volume successfully. Sep 17 15:07:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-45a7ed3a-f47e-4e3f-bdbb-83393933e053 tempest-VolumeQuotasAdminTestJSON-2101273792 None] Lock "cinder-8742acd9-9cf3-43f7-a098-d540695ff154-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Flow 'volume_create_manager' (b31b26b9-cfcb-4303-a8e0-6377d3fb7120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9acb04ca-44c8-462f-85fa-038f6080e882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9acb04ca-44c8-462f-85fa-038f6080e882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-864827664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c896856-e55b-49be-b78b-6b23acc6c39d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a86f9af0b304675afe294ff3814655b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:46Z,use_quota=True,user_id='109e7dee10084be3aed5e94ba13c69a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2619d632-db26-44a5-9bf2-bc34b4266a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2619d632-db26-44a5-9bf2-bc34b4266a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab3f9e6-44b1-4303-8a41-7a7963b4e801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab3f9e6-44b1-4303-8a41-7a7963b4e801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c896856-e55b-49be-b78b-6b23acc6c39d', 'volume_name': 'volume-6c896856-e55b-49be-b78b-6b23acc6c39d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47ff9e0-8473-4446-bfda-5b62ac811a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f47ff9e0-8473-4446-bfda-5b62ac811a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b573ec4a-8fd3-4530-b110-f22bf167fad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:45 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Volume 6c896856-e55b-49be-b78b-6b23acc6c39d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c896856-e55b-49be-b78b-6b23acc6c39d', 'volume_size': 1} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-864827664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c896856-e55b-49be-b78b-6b23acc6c39d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a86f9af0b304675afe294ff3814655b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:46Z,use_quota=True,user_id='109e7dee10084be3aed5e94ba13c69a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Creating volume 6c896856-e55b-49be-b78b-6b23acc6c39d {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:07:45 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:07:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:46 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d 1073741824 Sep 17 15:07:46 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:46 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d 1073741824" returned: 0 in 0.876s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:46 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d Sep 17 15:07:46 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:47 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d" returned: 0 in 0.479s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:07:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b573ec4a-8fd3-4530-b110-f22bf167fad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c896856-e55b-49be-b78b-6b23acc6c39d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4f5da7-c873-4ea9-9cec-93cd9c53b1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:47 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Volume volume-6c896856-e55b-49be-b78b-6b23acc6c39d (6c896856-e55b-49be-b78b-6b23acc6c39d): created successfully Sep 17 15:07:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4f5da7-c873-4ea9-9cec-93cd9c53b1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Flow 'volume_create_manager' (b31b26b9-cfcb-4303-a8e0-6377d3fb7120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:47 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5bd2ef92-2130-48af-bcaa-2e4128bc48ce tempest-VolumeDependencyTests-1424898993 None] Created volume successfully. Sep 17 15:07:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] Creating offline snapshot 7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 of volume 6c896856-e55b-49be-b78b-6b23acc6c39d {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:07:48 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[29924ed0-f822-443b-8a41-dd8855270690]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:48 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d Sep 17 15:07:48 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:48 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d" returned: 0 in 0.556s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:48 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 1G Sep 17 15:07:48 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:49 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 1G" returned: 0 in 0.835s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c896856-e55b-49be-b78b-6b23acc6c39d -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:49 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c896856-e55b-49be-b78b-6b23acc6c39d -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 Sep 17 15:07:49 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:50 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c896856-e55b-49be-b78b-6b23acc6c39d -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56" returned: 0 in 0.707s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:50 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 is being set with open permissions: ugo+rw Sep 17 15:07:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:50 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 Sep 17 15:07:50 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:50 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56" returned: 0 in 0.394s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:50 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.info Sep 17 15:07:50 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:51 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.info" returned: 0 in 0.382s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:51 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.info is being set with open permissions: ugo+rw Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:51 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.info Sep 17 15:07:51 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Flow 'volume_create_manager' (266c07bc-8320-4a00-ac27-81e30b8da58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d4e985-2556-4db3-9eae-b9db258b0193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d4e985-2556-4db3-9eae-b9db258b0193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1490806588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8067490-387e-4731-bb22-d3300a9574d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3db5f2207c6c4f41bd41f1f9fb6df05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:51Z,use_quota=True,user_id='15bffc058ca24a2fae6a2c6afdce114c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511ebc4e-0ae4-45aa-b59f-20479c6666ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (511ebc4e-0ae4-45aa-b59f-20479c6666ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df113e6-e96b-4e96-b82b-3f5e9c7c3e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df113e6-e96b-4e96-b82b-3f5e9c7c3e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8067490-387e-4731-bb22-d3300a9574d7', 'volume_name': 'volume-d8067490-387e-4731-bb22-d3300a9574d7', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fc1f953-3ac4-4b08-81a6-05cd141d9abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fc1f953-3ac4-4b08-81a6-05cd141d9abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08924cdc-1509-49b7-9cb2-93099af652cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Volume d8067490-387e-4731-bb22-d3300a9574d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8067490-387e-4731-bb22-d3300a9574d7', 'volume_size': 1} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:51 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.info" returned: 0 in 0.336s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.375s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.192s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1490806588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8067490-387e-4731-bb22-d3300a9574d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3db5f2207c6c4f41bd41f1f9fb6df05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:51Z,use_quota=True,user_id='15bffc058ca24a2fae6a2c6afdce114c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Creating volume d8067490-387e-4731-bb22-d3300a9574d7 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:07:51 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:07:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d8067490-387e-4731-bb22-d3300a9574d7 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:51 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d8067490-387e-4731-bb22-d3300a9574d7 1073741824 Sep 17 15:07:51 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1136be8f-585b-4c97-b629-26cf79024f63 tempest-VolumeDependencyTests-1424898993 None] Create snapshot completed successfully Sep 17 15:07:52 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d8067490-387e-4731-bb22-d3300a9574d7 1073741824" returned: 0 in 0.568s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d8067490-387e-4731-bb22-d3300a9574d7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:52 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d8067490-387e-4731-bb22-d3300a9574d7 Sep 17 15:07:52 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:52 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d8067490-387e-4731-bb22-d3300a9574d7" returned: 0 in 0.312s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:07:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08924cdc-1509-49b7-9cb2-93099af652cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8067490-387e-4731-bb22-d3300a9574d7', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55721ae-5b5d-4a6c-a10c-5f9fcab1c84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:52 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Volume volume-d8067490-387e-4731-bb22-d3300a9574d7 (d8067490-387e-4731-bb22-d3300a9574d7): created successfully Sep 17 15:07:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55721ae-5b5d-4a6c-a10c-5f9fcab1c84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Flow 'volume_create_manager' (266c07bc-8320-4a00-ac27-81e30b8da58c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e67c4e0f-fce4-46ce-9412-2186700eeac3 tempest-VolumesListTestJSON-1101406864 None] Created volume successfully. Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Flow 'volume_create_manager' (abf31dcf-2f9b-4900-ba1d-e2aae76c8b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77c1bf85-4343-4194-ae4a-7ffc6db8c14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77c1bf85-4343-4194-ae4a-7ffc6db8c14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1868689141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09910f63-e7ed-4e7f-9c60-d4554835f7c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a86f9af0b304675afe294ff3814655b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7afdcc62-2bb1-4f82-83cc-ac50e25b9b56,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:53Z,use_quota=True,user_id='109e7dee10084be3aed5e94ba13c69a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc28144-e249-40dd-b4d7-fb23771fee14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc28144-e249-40dd-b4d7-fb23771fee14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0463e325-e8dc-4d69-a872-a25ec8aa7151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0463e325-e8dc-4d69-a872-a25ec8aa7151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '09910f63-e7ed-4e7f-9c60-d4554835f7c6', 'volume_name': 'volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6', 'volume_size': 1, 'snapshot_id': '7afdcc62-2bb1-4f82-83cc-ac50e25b9b56'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905cd109-2e98-462b-babd-a3d788a151aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905cd109-2e98-462b-babd-a3d788a151aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b0f28b-aad9-49f3-b397-13194d8b8ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:53 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Volume 09910f63-e7ed-4e7f-9c60-d4554835f7c6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6', 'volume_size': 1, 'snapshot_id': '7afdcc62-2bb1-4f82-83cc-ac50e25b9b56'} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Acquiring lock "cinder-quobyte-7afdcc62-2bb1-4f82-83cc-ac50e25b9b56-09910f63-e7ed-4e7f-9c60-d4554835f7c6" by "_create_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Lock "cinder-quobyte-7afdcc62-2bb1-4f82-83cc-ac50e25b9b56-09910f63-e7ed-4e7f-9c60-d4554835f7c6" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Creating volume 09910f63-e7ed-4e7f-9c60-d4554835f7c6 from snapshot 7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 {{(pid=86082) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Acquiring lock "cinder-quobyte-09910f63-e7ed-4e7f-9c60-d4554835f7c6" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Lock "cinder-quobyte-09910f63-e7ed-4e7f-9c60-d4554835f7c6" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] snapshot: 7afdcc62-2bb1-4f82-83cc-ac50e25b9b56, volume: 09910f63-e7ed-4e7f-9c60-d4554835f7c6, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2187b6fa-3e4f-4644-a5c3-bfa63184464c]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:53 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 Sep 17 15:07:53 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:54 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Flow 'volume_create_manager' (259f63fa-8636-4e0e-b1da-0b5a7bac41fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec05d429-8fb4-4984-ac2f-b8bdbfe80837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56" returned: 0 in 0.598s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c896856-e55b-49be-b78b-6b23acc6c39d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec05d429-8fb4-4984-ac2f-b8bdbfe80837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-234418177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4113f90e-72a1-4670-b86d-7ba4cece5fa7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3db5f2207c6c4f41bd41f1f9fb6df05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:54Z,use_quota=True,user_id='15bffc058ca24a2fae6a2c6afdce114c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800f234b-62c1-4919-8cac-b53e5874fcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800f234b-62c1-4919-8cac-b53e5874fcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d5106d-3d8c-4b80-ba55-3cd8965d9a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d5106d-3d8c-4b80-ba55-3cd8965d9a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4113f90e-72a1-4670-b86d-7ba4cece5fa7', 'volume_name': 'volume-4113f90e-72a1-4670-b86d-7ba4cece5fa7', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4e0540-941e-4479-bfea-199a35345d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4e0540-941e-4479-bfea-199a35345d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb6c852-0229-48cc-af03-41fb6a13c806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:54 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Volume 4113f90e-72a1-4670-b86d-7ba4cece5fa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4113f90e-72a1-4670-b86d-7ba4cece5fa7', 'volume_size': 1} Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b6e507-da04-4b6c-9bd9-18314c11010a]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:54 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d Sep 17 15:07:54 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:54 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d" returned: 0 in 0.381s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Path /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6 not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:07:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:54 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6 Sep 17 15:07:54 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:57 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=122,cinder:SELECT=112,cinder:INSERT=33,cinder:DELETE=9 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:07:57 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=89,cinder:INSERT=27,cinder:UPDATE=122,cinder:DELETE=15 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:07:57 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Flow 'volume_create_manager' (c79b5792-ed30-4fc7-999a-af605acefdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279ca204-3de6-4a7a-ae28-6c3081961c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (279ca204-3de6-4a7a-ae28-6c3081961c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2100204729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54aaad3f-2ac7-43bd-a969-ac0e73cec43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4a2bb14f1c487088183563187c056f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:57Z,use_quota=True,user_id='4b010cf4c8f54223b17c59d66c597451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25cc4a1-5e43-4d4a-b6c4-02ea7fe6d01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e25cc4a1-5e43-4d4a-b6c4-02ea7fe6d01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167acaaf-c814-4f13-b84b-11f61ed8305e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167acaaf-c814-4f13-b84b-11f61ed8305e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54aaad3f-2ac7-43bd-a969-ac0e73cec43c', 'volume_name': 'volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f45541-52e9-4006-9000-148e473541fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f45541-52e9-4006-9000-148e473541fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (befab7b8-0527-4569-b893-2d60b712b307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:57 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Volume 54aaad3f-2ac7-43bd-a969-ac0e73cec43c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c', 'volume_size': 1} Sep 17 15:07:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:01 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6" returned: 0 in 6.757s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Image conversion details: src /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d, size 1024.00 MB, duration 6.76 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:08:01 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Converted 1024.00 MB image at 151.51 MB/s Sep 17 15:08:01 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6 is being set with open permissions: ugo+rw Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:01 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6 Sep 17 15:08:01 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:01 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6" returned: 0 in 0.286s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Lock "cinder-quobyte-09910f63-e7ed-4e7f-9c60-d4554835f7c6" released by "_copy_volume_from_snapshot" :: held 8.173s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Lock "cinder-quobyte-7afdcc62-2bb1-4f82-83cc-ac50e25b9b56-09910f63-e7ed-4e7f-9c60-d4554835f7c6" released by "_create_volume_from_snapshot" :: held 8.262s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.285s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.503s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-234418177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4113f90e-72a1-4670-b86d-7ba4cece5fa7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3db5f2207c6c4f41bd41f1f9fb6df05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:54Z,use_quota=True,user_id='15bffc058ca24a2fae6a2c6afdce114c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Creating volume 4113f90e-72a1-4670-b86d-7ba4cece5fa7 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:08:01 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4113f90e-72a1-4670-b86d-7ba4cece5fa7 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:01 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4113f90e-72a1-4670-b86d-7ba4cece5fa7 1073741824 Sep 17 15:08:01 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b0f28b-aad9-49f3-b397-13194d8b8ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6', 'volume_size': 1, 'snapshot_id': '7afdcc62-2bb1-4f82-83cc-ac50e25b9b56'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4596988-58d3-4985-ba15-2c68f740c292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:01 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Volume volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6 (09910f63-e7ed-4e7f-9c60-d4554835f7c6): created successfully Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4596988-58d3-4985-ba15-2c68f740c292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Flow 'volume_create_manager' (abf31dcf-2f9b-4900-ba1d-e2aae76c8b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:01 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b1a4e06c-07be-41e0-be4d-d018076b6a5c tempest-VolumeDependencyTests-1424898993 None] Created volume successfully. Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] Acquiring lock "cinder-7afdcc62-2bb1-4f82-83cc-ac50e25b9b56-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] Lock "cinder-7afdcc62-2bb1-4f82-83cc-ac50e25b9b56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] Acquiring lock "cinder-quobyte-6c896856-e55b-49be-b78b-6b23acc6c39d" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] Lock "cinder-quobyte-6c896856-e55b-49be-b78b-6b23acc6c39d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] Acquiring lock "cinder-quobyte-7afdcc62-2bb1-4f82-83cc-ac50e25b9b56" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] Lock "cinder-quobyte-7afdcc62-2bb1-4f82-83cc-ac50e25b9b56" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] Deleting offline snapshot 7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 of volume 6c896856-e55b-49be-b78b-6b23acc6c39d {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] snapshot_file for this snap is: volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f6f5b3-7a3b-4c9a-848d-6fefc11efc01]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:02 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 Sep 17 15:08:02 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:02 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4113f90e-72a1-4670-b86d-7ba4cece5fa7 1073741824" returned: 0 in 0.490s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4113f90e-72a1-4670-b86d-7ba4cece5fa7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:02 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4113f90e-72a1-4670-b86d-7ba4cece5fa7 Sep 17 15:08:02 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:02 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56" returned: 0 in 0.385s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c896856-e55b-49be-b78b-6b23acc6c39d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34b320a-38ea-411c-a71b-59bb2c0b33cd]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:02 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4113f90e-72a1-4670-b86d-7ba4cece5fa7" returned: 0 in 0.270s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.952s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2100204729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54aaad3f-2ac7-43bd-a969-ac0e73cec43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4a2bb14f1c487088183563187c056f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:57Z,use_quota=True,user_id='4b010cf4c8f54223b17c59d66c597451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Creating volume 54aaad3f-2ac7-43bd-a969-ac0e73cec43c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:08:02 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:02 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c 1073741824 Sep 17 15:08:02 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbb6c852-0229-48cc-af03-41fb6a13c806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4113f90e-72a1-4670-b86d-7ba4cece5fa7', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebabbe59-a949-46e8-bf20-5e45335aaed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:02 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Volume volume-4113f90e-72a1-4670-b86d-7ba4cece5fa7 (4113f90e-72a1-4670-b86d-7ba4cece5fa7): created successfully Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebabbe59-a949-46e8-bf20-5e45335aaed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Flow 'volume_create_manager' (259f63fa-8636-4e0e-b1da-0b5a7bac41fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:02 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-127280a2-3f07-4557-aa08-1c767c324ebc tempest-VolumesListTestJSON-1101406864 None] Created volume successfully. Sep 17 15:08:02 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d Sep 17 15:08:02 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:03 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d" returned: 0 in 0.679s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:03 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c 1073741824" returned: 0 in 0.663s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:03 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 Sep 17 15:08:03 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:03 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c Sep 17 15:08:03 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Flow 'volume_create_manager' (69efa5bb-3ef2-48fe-8c4e-69288941d94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab25bf29-0c98-4652-b7ce-27330ce71cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:03 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab25bf29-0c98-4652-b7ce-27330ce71cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1545922392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06589f64-df5f-42d4-86eb-c8bb3defb46b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3db5f2207c6c4f41bd41f1f9fb6df05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:08:03Z,use_quota=True,user_id='15bffc058ca24a2fae6a2c6afdce114c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58eb18ae-0c90-43fb-8792-be01e0c4bdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58eb18ae-0c90-43fb-8792-be01e0c4bdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e012bb11-e85a-44a3-98f7-4eea9d9c8237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e012bb11-e85a-44a3-98f7-4eea9d9c8237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06589f64-df5f-42d4-86eb-c8bb3defb46b', 'volume_name': 'volume-06589f64-df5f-42d4-86eb-c8bb3defb46b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3362c1-5a98-425e-b28b-519ab7426f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3362c1-5a98-425e-b28b-519ab7426f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:03 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e863600-3fc3-4767-bfbb-334263df0ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:03 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Volume 06589f64-df5f-42d4-86eb-c8bb3defb46b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06589f64-df5f-42d4-86eb-c8bb3defb46b', 'volume_size': 1} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c" returned: 0 in 0.364s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56" returned: 0 in 0.422s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1545922392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06589f64-df5f-42d4-86eb-c8bb3defb46b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3db5f2207c6c4f41bd41f1f9fb6df05a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:08:03Z,use_quota=True,user_id='15bffc058ca24a2fae6a2c6afdce114c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Creating volume 06589f64-df5f-42d4-86eb-c8bb3defb46b {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:08:03 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-06589f64-df5f-42d4-86eb-c8bb3defb46b 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:03 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-06589f64-df5f-42d4-86eb-c8bb3defb46b 1073741824 Sep 17 15:08:03 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:03 devstack sudo[100200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56 Sep 17 15:08:03 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (befab7b8-0527-4569-b893-2d60b712b307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843b7cf3-3bfc-4fb7-95bd-1bf59cfab757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:03 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Volume volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c (54aaad3f-2ac7-43bd-a969-ac0e73cec43c): created successfully Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843b7cf3-3bfc-4fb7-95bd-1bf59cfab757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Flow 'volume_create_manager' (c79b5792-ed30-4fc7-999a-af605acefdb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-91a2c707-2ec9-4f5a-85a1-059b5d2f42d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Created volume successfully. Sep 17 15:08:03 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d.7afdcc62-2bb1-4f82-83cc-ac50e25b9b56" returned: 0 in 0.366s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] Lock "cinder-quobyte-7afdcc62-2bb1-4f82-83cc-ac50e25b9b56" released by "_delete_snapshot" :: held 2.006s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] Lock "cinder-quobyte-6c896856-e55b-49be-b78b-6b23acc6c39d" released by "delete_snapshot" :: held 2.038s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:04 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] Created reservations ['668fc68f-f8b1-44c0-87fd-937e9b6910eb', '08dd9bc4-4621-4788-9275-525d5e14a68e', '5de3df0b-acb9-4211-b258-1ffc5d95be5b', '18a1e13f-a94e-4e69-9605-627aa963e7e1'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:08:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:04 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] Delete snapshot completed successfully. Sep 17 15:08:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-64e86d3a-0967-454f-bedb-5fb83cb6b72c tempest-VolumeDependencyTests-1424898993 None] Lock "cinder-7afdcc62-2bb1-4f82-83cc-ac50e25b9b56-delete_snapshot" released by "delete_snapshot" :: held 2.347s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:04 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-06589f64-df5f-42d4-86eb-c8bb3defb46b 1073741824" returned: 0 in 0.771s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-06589f64-df5f-42d4-86eb-c8bb3defb46b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:04 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-06589f64-df5f-42d4-86eb-c8bb3defb46b Sep 17 15:08:04 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:04 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-06589f64-df5f-42d4-86eb-c8bb3defb46b" returned: 0 in 0.282s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:08:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.393s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e863600-3fc3-4767-bfbb-334263df0ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06589f64-df5f-42d4-86eb-c8bb3defb46b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e35818-a2bf-4657-8b17-7d86ba5debaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Creating offline snapshot ba00234b-844c-4146-9e38-dcf576e62a6e of volume 54aaad3f-2ac7-43bd-a969-ac0e73cec43c {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:08:04 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Volume volume-06589f64-df5f-42d4-86eb-c8bb3defb46b (06589f64-df5f-42d4-86eb-c8bb3defb46b): created successfully Sep 17 15:08:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e35818-a2bf-4657-8b17-7d86ba5debaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Flow 'volume_create_manager' (69efa5bb-3ef2-48fe-8c4e-69288941d94d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:04 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46af8cb-354e-441b-8e91-5219f803540f]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:04 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-887cbe28-abc5-4df5-91c6-e2002c6a84e9 tempest-VolumesListTestJSON-1101406864 None] Created volume successfully. Sep 17 15:08:04 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c Sep 17 15:08:04 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-d9bca095-6125-4cb9-852c-99762f79dd12 req-81dae340-538e-4abe-be95-fa1852ac3252 tempest-TestInstancesWithCinderVolumes-1537908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:05 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c" returned: 0 in 0.403s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] Acquiring lock "cinder-6c896856-e55b-49be-b78b-6b23acc6c39d-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:05 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e 1G Sep 17 15:08:05 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] Lock "cinder-6c896856-e55b-49be-b78b-6b23acc6c39d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] Acquiring lock "cinder-quobyte-6c896856-e55b-49be-b78b-6b23acc6c39d" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] Lock "cinder-quobyte-6c896856-e55b-49be-b78b-6b23acc6c39d" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:05 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d4b0f5-9a9a-4e15-8470-b6091e11b2d8]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:05 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d Sep 17 15:08:05 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:05 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e 1G" returned: 0 in 0.490s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:05 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e Sep 17 15:08:05 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:05 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d" returned: 0 in 0.410s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:05 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d Sep 17 15:08:05 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:05 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e" returned: 0 in 0.326s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:05 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e is being set with open permissions: ugo+rw Sep 17 15:08:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:05 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e Sep 17 15:08:05 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:06 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6c896856-e55b-49be-b78b-6b23acc6c39d" returned: 0 in 0.296s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] Lock "cinder-quobyte-6c896856-e55b-49be-b78b-6b23acc6c39d" released by "delete_volume" :: held 0.774s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] Created reservations ['addc3d6c-8a81-4b3e-9d47-0362bb099128', 'f3d72280-a983-4d7e-80e3-aba011025d51', '355fa7c1-028a-4434-bbb2-412f39cf0cfc', 'e0d35d1c-d2d7-4836-a46e-e8fa1659e304'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:06 devstack sudo[100252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:08:06 devstack sudo[100252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:06 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e" returned: 0 in 0.291s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:06 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.info Sep 17 15:08:06 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:06 devstack sudo[100252]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.272s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:08:06 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] Deleted volume successfully. Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e3d7e3b7-e2eb-49aa-839c-02d083800d92 tempest-VolumeDependencyTests-1424898993 None] Lock "cinder-6c896856-e55b-49be-b78b-6b23acc6c39d-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:06 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.info" returned: 0 in 0.288s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:06 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.info is being set with open permissions: ugo+rw Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:06 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.info Sep 17 15:08:06 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] Acquiring lock "cinder-09910f63-e7ed-4e7f-9c60-d4554835f7c6-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] Lock "cinder-09910f63-e7ed-4e7f-9c60-d4554835f7c6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] Acquiring lock "cinder-quobyte-09910f63-e7ed-4e7f-9c60-d4554835f7c6" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] Lock "cinder-quobyte-09910f63-e7ed-4e7f-9c60-d4554835f7c6" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc5f697-6003-4c2e-a118-87c8a2cb1bc0]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:06 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6 Sep 17 15:08:06 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:06 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.info" returned: 0 in 0.318s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-d9bca095-6125-4cb9-852c-99762f79dd12 req-81dae340-538e-4abe-be95-fa1852ac3252 tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.940s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-d9bca095-6125-4cb9-852c-99762f79dd12 req-81dae340-538e-4abe-be95-fa1852ac3252 tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:06 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8847e71d-2975-4ed5-8e23-f3e0965e6f15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Create snapshot completed successfully Sep 17 15:08:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-d9bca095-6125-4cb9-852c-99762f79dd12 req-81dae340-538e-4abe-be95-fa1852ac3252 tempest-TestInstancesWithCinderVolumes-1537908 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-c1065d52-b822-46a4-9e68-9af3f43204c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac77f39b-2804-4fe4-8f17-93cd3e81e867', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:08:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-d9bca095-6125-4cb9-852c-99762f79dd12 req-81dae340-538e-4abe-be95-fa1852ac3252 tempest-TestInstancesWithCinderVolumes-1537908 None] attachment_update completed successfully. Sep 17 15:08:07 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6" returned: 0 in 0.456s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:07 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6 Sep 17 15:08:07 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:07 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-09910f63-e7ed-4e7f-9c60-d4554835f7c6" returned: 0 in 0.298s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] Lock "cinder-quobyte-09910f63-e7ed-4e7f-9c60-d4554835f7c6" released by "delete_volume" :: held 0.814s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:07 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] Created reservations ['c4b8e400-068b-4897-9b99-39d680a46836', '4d2578b3-68c3-4c70-a0ed-a1c8518c184b', '92250d12-6a1f-483c-bfa7-450066066acb', 'a69b4d08-1b13-4c92-b074-81f3b0e23374'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:08:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:07 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:08:07 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:07 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.286s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:07 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:08:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] Deleted volume successfully. Sep 17 15:08:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0560ac3a-dfbc-4f48-9486-5ccabdb0e307 tempest-VolumeDependencyTests-1424898993 None] Lock "cinder-09910f63-e7ed-4e7f-9c60-d4554835f7c6-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Acquiring lock "cinder-ba00234b-844c-4146-9e38-dcf576e62a6e-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Lock "cinder-ba00234b-844c-4146-9e38-dcf576e62a6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Acquiring lock "cinder-quobyte-54aaad3f-2ac7-43bd-a969-ac0e73cec43c" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Lock "cinder-quobyte-54aaad3f-2ac7-43bd-a969-ac0e73cec43c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Acquiring lock "cinder-quobyte-ba00234b-844c-4146-9e38-dcf576e62a6e" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Lock "cinder-quobyte-ba00234b-844c-4146-9e38-dcf576e62a6e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Deleting offline snapshot ba00234b-844c-4146-9e38-dcf576e62a6e of volume 54aaad3f-2ac7-43bd-a969-ac0e73cec43c {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:08:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] snapshot_file for this snap is: volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:08:08 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd2c2e8-d215-4216-a461-d3ef4b106a3d]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:08 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e Sep 17 15:08:08 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] Acquiring lock "cinder-06589f64-df5f-42d4-86eb-c8bb3defb46b-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] Lock "cinder-06589f64-df5f-42d4-86eb-c8bb3defb46b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] Acquiring lock "cinder-quobyte-06589f64-df5f-42d4-86eb-c8bb3defb46b" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] Lock "cinder-quobyte-06589f64-df5f-42d4-86eb-c8bb3defb46b" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:08 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[383743cb-2841-448e-bb6e-b8c470b341c9]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-06589f64-df5f-42d4-86eb-c8bb3defb46b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:08 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-06589f64-df5f-42d4-86eb-c8bb3defb46b Sep 17 15:08:08 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:09 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e" returned: 0 in 0.578s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:08:09 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21e5831-ef05-4daf-9e96-c520f3eff047]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:09 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c Sep 17 15:08:09 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:09 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-06589f64-df5f-42d4-86eb-c8bb3defb46b" returned: 0 in 0.459s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-06589f64-df5f-42d4-86eb-c8bb3defb46b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:09 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-06589f64-df5f-42d4-86eb-c8bb3defb46b Sep 17 15:08:09 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:09 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-06589f64-df5f-42d4-86eb-c8bb3defb46b" returned: 0 in 0.414s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] Lock "cinder-quobyte-06589f64-df5f-42d4-86eb-c8bb3defb46b" released by "delete_volume" :: held 0.930s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:09 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c" returned: 0 in 0.651s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:09 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e Sep 17 15:08:09 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:09 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] Created reservations ['310645b9-c293-4368-9f28-b288fea23d80', '5b3b08d5-88fd-494c-99b9-ff92e1337fe0', '770a4328-17a7-4340-978c-bc7e240a35b5', 'd8048259-fd8f-4d8e-8201-62c52e07496c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:08:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:09 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:08:09 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-bcf889d7-8377-48b6-9d9c-02419ad31d43 req-7c1f5d9d-89b6-4841-a41d-6efbff000458 tempest-TestInstancesWithCinderVolumes-1537908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-bcf889d7-8377-48b6-9d9c-02419ad31d43 req-7c1f5d9d-89b6-4841-a41d-6efbff000458 tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-bcf889d7-8377-48b6-9d9c-02419ad31d43 req-7c1f5d9d-89b6-4841-a41d-6efbff000458 tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-bcf889d7-8377-48b6-9d9c-02419ad31d43 req-7c1f5d9d-89b6-4841-a41d-6efbff000458 tempest-TestInstancesWithCinderVolumes-1537908 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-1d63450b-6ad9-4503-bfed-5357d44b46af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '403ff111-78e4-44f0-a73b-a40a068b7cb5', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:08:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-bcf889d7-8377-48b6-9d9c-02419ad31d43 req-7c1f5d9d-89b6-4841-a41d-6efbff000458 tempest-TestInstancesWithCinderVolumes-1537908 None] attachment_update completed successfully. Sep 17 15:08:10 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.422s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:10 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:08:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] Deleted volume successfully. Sep 17 15:08:10 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e" returned: 0 in 0.662s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c4037b5f-9a67-4714-9d62-0b55530133c2 tempest-VolumesListTestJSON-1101406864 None] Lock "cinder-06589f64-df5f-42d4-86eb-c8bb3defb46b-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:10 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e Sep 17 15:08:10 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:10 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c.ba00234b-844c-4146-9e38-dcf576e62a6e" returned: 0 in 0.353s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Lock "cinder-quobyte-ba00234b-844c-4146-9e38-dcf576e62a6e" released by "_delete_snapshot" :: held 2.428s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Lock "cinder-quobyte-54aaad3f-2ac7-43bd-a969-ac0e73cec43c" released by "delete_snapshot" :: held 2.456s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:10 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Created reservations ['e2a08753-7459-47cd-b95e-cd4a9eacc6e8', '36f06dcf-2e48-48e2-9713-f059538a301b', '81634b56-c17a-41fa-b4c4-d123d38352fe', '073805b6-f5c9-4e25-a928-9a25533677d7'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:08:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Delete snapshot completed successfully. Sep 17 15:08:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-51a35887-5bed-4796-928e-ffe9da96b440 tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Lock "cinder-ba00234b-844c-4146-9e38-dcf576e62a6e-delete_snapshot" released by "delete_snapshot" :: held 2.643s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] Acquiring lock "cinder-4113f90e-72a1-4670-b86d-7ba4cece5fa7-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] Lock "cinder-4113f90e-72a1-4670-b86d-7ba4cece5fa7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] Acquiring lock "cinder-quobyte-4113f90e-72a1-4670-b86d-7ba4cece5fa7" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] Lock "cinder-quobyte-4113f90e-72a1-4670-b86d-7ba4cece5fa7" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:11 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90a83a7-c8fd-4adb-b0e9-7766cda998a8]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4113f90e-72a1-4670-b86d-7ba4cece5fa7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:11 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4113f90e-72a1-4670-b86d-7ba4cece5fa7 Sep 17 15:08:11 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:11 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4113f90e-72a1-4670-b86d-7ba4cece5fa7" returned: 0 in 0.407s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4113f90e-72a1-4670-b86d-7ba4cece5fa7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:11 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4113f90e-72a1-4670-b86d-7ba4cece5fa7 Sep 17 15:08:11 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Acquiring lock "cinder-54aaad3f-2ac7-43bd-a969-ac0e73cec43c-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Lock "cinder-54aaad3f-2ac7-43bd-a969-ac0e73cec43c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Acquiring lock "cinder-quobyte-54aaad3f-2ac7-43bd-a969-ac0e73cec43c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Lock "cinder-quobyte-54aaad3f-2ac7-43bd-a969-ac0e73cec43c" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:11 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c360c6-10e9-47a0-937b-55e6a55a8005]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:11 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4113f90e-72a1-4670-b86d-7ba4cece5fa7" returned: 0 in 0.313s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] Lock "cinder-quobyte-4113f90e-72a1-4670-b86d-7ba4cece5fa7" released by "delete_volume" :: held 0.770s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:11 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c Sep 17 15:08:11 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:11 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] Created reservations ['cd51fe3d-64f8-4682-853d-c4e0e16bdf22', 'f82c7bed-956c-45e5-89a4-26d2ac986866', 'c2fb629b-dad8-4c91-b3a7-e933f80331f3', 'ef8a62f0-85ba-4051-8ef9-e131965b4fbb'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:12 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:08:12 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:12 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c" returned: 0 in 0.479s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:12 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c Sep 17 15:08:12 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] Acquiring lock "cinder-d8067490-387e-4731-bb22-d3300a9574d7-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] Lock "cinder-d8067490-387e-4731-bb22-d3300a9574d7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] Acquiring lock "cinder-quobyte-d8067490-387e-4731-bb22-d3300a9574d7" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:12 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.430s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] Lock "cinder-quobyte-d8067490-387e-4731-bb22-d3300a9574d7" acquired by "delete_volume" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:12 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] Deleted volume successfully. Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ba71d47e-200b-46fe-87ad-9ea044e398dd tempest-VolumesListTestJSON-1101406864 None] Lock "cinder-4113f90e-72a1-4670-b86d-7ba4cece5fa7-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5134b4f3-a870-4046-994f-3d22982dd2c5]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d8067490-387e-4731-bb22-d3300a9574d7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:12 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-54aaad3f-2ac7-43bd-a969-ac0e73cec43c" returned: 0 in 0.410s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Lock "cinder-quobyte-54aaad3f-2ac7-43bd-a969-ac0e73cec43c" released by "delete_volume" :: held 0.991s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:12 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d8067490-387e-4731-bb22-d3300a9574d7 Sep 17 15:08:12 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Created reservations ['a135a10a-fc0d-4b98-a1d7-cdd2fcc3aff0', '7dabf8c8-bf34-4dd0-a51b-710988a6a8bf', 'adea4407-445d-46cc-925c-de2e86350dc0', '19f73f0e-f637-4a0a-b992-093e8cf223a7'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:12 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:08:12 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:13 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d8067490-387e-4731-bb22-d3300a9574d7" returned: 0 in 0.524s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d8067490-387e-4731-bb22-d3300a9574d7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:13 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d8067490-387e-4731-bb22-d3300a9574d7 Sep 17 15:08:13 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:13 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.338s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:13 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:08:13 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Deleted volume successfully. Sep 17 15:08:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7a7d7085-1870-446f-ac59-31fb161510cb tempest-VolumeSnapshotQuotasNegativeTestJSON-1551675557 None] Lock "cinder-54aaad3f-2ac7-43bd-a969-ac0e73cec43c-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:13 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d8067490-387e-4731-bb22-d3300a9574d7" returned: 0 in 0.330s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] Lock "cinder-quobyte-d8067490-387e-4731-bb22-d3300a9574d7" released by "delete_volume" :: held 0.934s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:13 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] Created reservations ['70cba052-361b-4cd6-b6ef-36df5d28e32f', '88ca8d9f-3312-4e73-9001-1c134226e321', '4199ea84-f6ee-4427-b531-03296e9a65d9', 'f3607bf3-ab56-4d0f-b685-bd2327887ffb'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:08:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:13 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:08:13 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:13 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.299s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:13 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:08:13 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] Deleted volume successfully. Sep 17 15:08:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-10d1afca-52c4-49c0-b6aa-4a0fd4d5eab1 tempest-VolumesListTestJSON-1101406864 None] Lock "cinder-d8067490-387e-4731-bb22-d3300a9574d7-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:16 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-d35b0e07-0565-48da-96a9-c006556e91d3 req-f4a50c18-8ac7-4139-8788-70b4995c79c8 tempest-TestInstancesWithCinderVolumes-1537908 None] Terminate volume connection completed successfully. Sep 17 15:08:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-d35b0e07-0565-48da-96a9-c006556e91d3 req-f4a50c18-8ac7-4139-8788-70b4995c79c8 tempest-TestInstancesWithCinderVolumes-1537908 None] Deleting attachment ac77f39b-2804-4fe4-8f17-93cd3e81e867. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:08:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Acquiring lock "cinder-c1065d52-b822-46a4-9e68-9af3f43204c7-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "cinder-c1065d52-b822-46a4-9e68-9af3f43204c7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Acquiring lock "cinder-quobyte-c1065d52-b822-46a4-9e68-9af3f43204c7" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "cinder-quobyte-c1065d52-b822-46a4-9e68-9af3f43204c7" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:17 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb296e8-4c36-44cf-b890-80cbaf4caf20]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c1065d52-b822-46a4-9e68-9af3f43204c7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:17 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c1065d52-b822-46a4-9e68-9af3f43204c7 Sep 17 15:08:17 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:18 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c1065d52-b822-46a4-9e68-9af3f43204c7" returned: 0 in 0.522s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c1065d52-b822-46a4-9e68-9af3f43204c7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:18 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c1065d52-b822-46a4-9e68-9af3f43204c7 Sep 17 15:08:18 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:18 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c1065d52-b822-46a4-9e68-9af3f43204c7" returned: 0 in 0.409s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "cinder-quobyte-c1065d52-b822-46a4-9e68-9af3f43204c7" released by "delete_volume" :: held 1.014s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:18 devstack cinder-volume[86082]: WARNING cinder.quota [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2070851362-538750976 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2070851362-538750976, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:08:18 devstack cinder-volume[86082]: WARNING cinder.quota [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2070851362-538750976 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2070851362-538750976, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:08:18 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Created reservations ['6135a9bb-e0e3-438d-9f7e-dc400848eff4', 'ba3f2f27-bd29-4184-add2-526b27bce53b', 'ff6bb602-f074-4952-963d-56cc1db8e866', 'e2870772-3bac-49bf-a6fa-00502f3d8a8f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:08:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:18 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:08:18 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:19 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.475s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:19 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:08:19 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Deleted volume successfully. Sep 17 15:08:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-820bf4cc-4bde-4724-b78c-0e99b7d8549d tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "cinder-c1065d52-b822-46a4-9e68-9af3f43204c7-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-5fe7ab83-afc7-4d1e-9322-f4fecd343a65 req-0e4b7714-6243-4f54-ac99-b6febbdf22b9 tempest-TestInstancesWithCinderVolumes-1537908 None] Terminate volume connection completed successfully. Sep 17 15:08:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-5fe7ab83-afc7-4d1e-9322-f4fecd343a65 req-0e4b7714-6243-4f54-ac99-b6febbdf22b9 tempest-TestInstancesWithCinderVolumes-1537908 None] Deleting attachment 403ff111-78e4-44f0-a73b-a40a068b7cb5. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:08:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Acquiring lock "cinder-1d63450b-6ad9-4503-bfed-5357d44b46af-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "cinder-1d63450b-6ad9-4503-bfed-5357d44b46af-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Acquiring lock "cinder-quobyte-1d63450b-6ad9-4503-bfed-5357d44b46af" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "cinder-quobyte-1d63450b-6ad9-4503-bfed-5357d44b46af" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:23 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ebcaae-9324-491d-90ab-a8998d9b0f0a]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d63450b-6ad9-4503-bfed-5357d44b46af {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:23 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d63450b-6ad9-4503-bfed-5357d44b46af Sep 17 15:08:23 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:24 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d63450b-6ad9-4503-bfed-5357d44b46af" returned: 0 in 0.565s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d63450b-6ad9-4503-bfed-5357d44b46af {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:24 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d63450b-6ad9-4503-bfed-5357d44b46af Sep 17 15:08:24 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:24 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d63450b-6ad9-4503-bfed-5357d44b46af" returned: 0 in 0.369s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "cinder-quobyte-1d63450b-6ad9-4503-bfed-5357d44b46af" released by "delete_volume" :: held 1.019s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:24 devstack cinder-volume[86082]: WARNING cinder.quota [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-951721549-973064966 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-951721549-973064966, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:08:24 devstack cinder-volume[86082]: WARNING cinder.quota [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-951721549-973064966 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-951721549-973064966, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:08:24 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Created reservations ['67a60a8b-a8c8-4e5b-b630-02965899ae10', '466c112f-2356-4d97-aa62-46b6a7e93d2e', '3ffb7b19-c2b8-4947-9208-50402e863895', 'e64f7372-8e68-4d4a-8dfa-c12eafb567ce'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:08:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:24 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:08:24 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:24 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.311s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:24 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:08:24 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Deleted volume successfully. Sep 17 15:08:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-23b890f8-d955-45fe-ba00-d488344adc55 tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "cinder-1d63450b-6ad9-4503-bfed-5357d44b46af-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:34 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=74,cinder:UPDATE=90,cinder:INSERT=22,cinder:DELETE=7 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:08:34 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=77,cinder:UPDATE=90,cinder:INSERT=23,cinder:DELETE=6 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:08:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:08:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:40 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:08:40 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:40 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.323s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:08:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:08:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:08:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:08:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-7676c307-ba11-4a62-8314-c37247806418 req-38bc29be-e5e2-4a29-bd12-229387b643c8 tempest-TestInstancesWithCinderVolumes-1537908 None] Terminate volume connection completed successfully. Sep 17 15:08:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-7676c307-ba11-4a62-8314-c37247806418 req-38bc29be-e5e2-4a29-bd12-229387b643c8 tempest-TestInstancesWithCinderVolumes-1537908 None] Deleting attachment 7e3857ac-2a8f-485c-af63-7597f88850ef. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:08:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Acquiring lock "cinder-31996447-9f16-4a62-a279-a5d6243690d0-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "cinder-31996447-9f16-4a62-a279-a5d6243690d0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Acquiring lock "cinder-quobyte-31996447-9f16-4a62-a279-a5d6243690d0" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "cinder-quobyte-31996447-9f16-4a62-a279-a5d6243690d0" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67453c0-2dbe-4c6e-b20b-dc326cfb4ec5]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:44 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0 Sep 17 15:08:44 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:44 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0" returned: 0 in 0.451s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:44 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0 Sep 17 15:08:44 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:44 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31996447-9f16-4a62-a279-a5d6243690d0" returned: 0 in 0.314s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "cinder-quobyte-31996447-9f16-4a62-a279-a5d6243690d0" released by "delete_volume" :: held 0.825s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:44 devstack cinder-volume[86082]: WARNING cinder.quota [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1827706641-1024657390 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1827706641-1024657390, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:08:44 devstack cinder-volume[86082]: WARNING cinder.quota [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1827706641-1024657390 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1827706641-1024657390, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:08:44 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Created reservations ['4ed246a3-1b29-49f1-80f7-78c0823e82a8', '73ff4dad-ff3b-4da4-912e-0bd32216bc07', '011d6a8b-7eb1-4ad8-a95c-a2086b2edf33', '151fb036-514e-4e3d-8878-3bf715235d42'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:08:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:44 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:08:44 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:45 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.498s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:45 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:08:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Deleted volume successfully. Sep 17 15:08:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c95e9295-d561-457a-97c7-24626315e5cd tempest-TestInstancesWithCinderVolumes-1537908 None] Lock "cinder-31996447-9f16-4a62-a279-a5d6243690d0-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:54 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:08:55 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Flow 'volume_create_manager' (8f7373b5-86ea-40e6-992b-f1f6b0bfb96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b565255-113b-42cd-a945-7b7e5c6c586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b565255-113b-42cd-a945-7b7e5c6c586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1220721223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf1c856-7483-46be-9f40-b6009c2f6751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5004592fca1483a9dca4e26b9676e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:08:56Z,use_quota=True,user_id='78dbc12d44794f57a767a568c4569076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b2c730-2f60-4a24-960b-b4053ad92c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b2c730-2f60-4a24-960b-b4053ad92c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9821de85-8afe-46ad-aa8e-ee810affb0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9821de85-8afe-46ad-aa8e-ee810affb0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf1c856-7483-46be-9f40-b6009c2f6751', 'volume_name': 'volume-2bf1c856-7483-46be-9f40-b6009c2f6751', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26cd7807-adb8-47b1-a2c2-87e94dd0f330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26cd7807-adb8-47b1-a2c2-87e94dd0f330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ab1dfc-a91e-4cd9-9a51-a3f3d155e04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:56 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Volume 2bf1c856-7483-46be-9f40-b6009c2f6751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf1c856-7483-46be-9f40-b6009c2f6751', 'volume_size': 1} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1220721223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf1c856-7483-46be-9f40-b6009c2f6751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5004592fca1483a9dca4e26b9676e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:08:56Z,use_quota=True,user_id='78dbc12d44794f57a767a568c4569076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Creating volume 2bf1c856-7483-46be-9f40-b6009c2f6751 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:08:56 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:56 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 1073741824 Sep 17 15:08:56 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:56 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 1073741824" returned: 0 in 0.612s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:57 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 Sep 17 15:08:57 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:57 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751" returned: 0 in 0.353s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:08:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22ab1dfc-a91e-4cd9-9a51-a3f3d155e04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf1c856-7483-46be-9f40-b6009c2f6751', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179a2ab1-76e2-40a4-b48e-abd2f54ad412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:57 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Volume volume-2bf1c856-7483-46be-9f40-b6009c2f6751 (2bf1c856-7483-46be-9f40-b6009c2f6751): created successfully Sep 17 15:08:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179a2ab1-76e2-40a4-b48e-abd2f54ad412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Flow 'volume_create_manager' (8f7373b5-86ea-40e6-992b-f1f6b0bfb96e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4f082bf3-a29e-4ab1-93e7-cb37573898f6 tempest-SnapshotDependencyTests-180119662 None] Created volume successfully. Sep 17 15:08:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] Creating offline snapshot d92e5309-4080-42b8-9f9c-35b82951805f of volume 2bf1c856-7483-46be-9f40-b6009c2f6751 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:08:58 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1d2f7d-24cb-49ad-8fd8-17c1e05af521]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:58 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 Sep 17 15:08:58 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:59 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751" returned: 0 in 0.465s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:59 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f 1G Sep 17 15:08:59 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:59 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f 1G" returned: 0 in 0.730s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bf1c856-7483-46be-9f40-b6009c2f6751 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:59 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bf1c856-7483-46be-9f40-b6009c2f6751 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f Sep 17 15:08:59 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bf1c856-7483-46be-9f40-b6009c2f6751 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f" returned: 0 in 0.390s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:00 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f is being set with open permissions: ugo+rw Sep 17 15:09:00 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:00 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f Sep 17 15:09:00 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:00 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f" returned: 0 in 0.302s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:00 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.info Sep 17 15:09:00 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:00 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.info" returned: 0 in 0.321s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:00 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.info is being set with open permissions: ugo+rw Sep 17 15:09:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:01 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.info Sep 17 15:09:01 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:01 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.info" returned: 0 in 0.310s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.659s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:01 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ef9420ca-8de7-458d-af92-05474abd01fc tempest-SnapshotDependencyTests-180119662 None] Create snapshot completed successfully Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Flow 'volume_create_manager' (3b39089e-54da-4c8d-ba68-cf4ef52c76ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073e61a4-7dbd-48d8-9b43-f87db2b674c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073e61a4-7dbd-48d8-9b43-f87db2b674c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea9c310-daaf-4e0c-8742-d21a568551c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5004592fca1483a9dca4e26b9676e7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d92e5309-4080-42b8-9f9c-35b82951805f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:03Z,use_quota=True,user_id='78dbc12d44794f57a767a568c4569076',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9408a8-0972-4458-89e0-714f5540f904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c9408a8-0972-4458-89e0-714f5540f904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7064ad0-32cb-4603-b0c0-3b3aadcdead0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7064ad0-32cb-4603-b0c0-3b3aadcdead0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5ea9c310-daaf-4e0c-8742-d21a568551c7', 'volume_name': 'volume-5ea9c310-daaf-4e0c-8742-d21a568551c7', 'volume_size': 1, 'snapshot_id': 'd92e5309-4080-42b8-9f9c-35b82951805f'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8caa3d-2299-4df4-a8eb-1600d8c2df2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8caa3d-2299-4df4-a8eb-1600d8c2df2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066347b5-3e01-442d-95e6-845f0ad3866e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:03 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Volume 5ea9c310-daaf-4e0c-8742-d21a568551c7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5ea9c310-daaf-4e0c-8742-d21a568551c7', 'volume_size': 1, 'snapshot_id': 'd92e5309-4080-42b8-9f9c-35b82951805f'} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Acquiring lock "cinder-quobyte-d92e5309-4080-42b8-9f9c-35b82951805f-5ea9c310-daaf-4e0c-8742-d21a568551c7" by "_create_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Lock "cinder-quobyte-d92e5309-4080-42b8-9f9c-35b82951805f-5ea9c310-daaf-4e0c-8742-d21a568551c7" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Creating volume 5ea9c310-daaf-4e0c-8742-d21a568551c7 from snapshot d92e5309-4080-42b8-9f9c-35b82951805f {{(pid=86082) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Acquiring lock "cinder-quobyte-5ea9c310-daaf-4e0c-8742-d21a568551c7" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Lock "cinder-quobyte-5ea9c310-daaf-4e0c-8742-d21a568551c7" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] snapshot: d92e5309-4080-42b8-9f9c-35b82951805f, volume: 5ea9c310-daaf-4e0c-8742-d21a568551c7, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ac0693-b38b-4cfd-b925-61632242fc73]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:03 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f Sep 17 15:09:03 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:04 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f" returned: 0 in 0.892s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bf1c856-7483-46be-9f40-b6009c2f6751(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:09:04 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab97071b-2af6-410b-bc4a-b664468667e2]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:04 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 Sep 17 15:09:04 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:05 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751" returned: 0 in 0.641s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:09:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:09:05 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Path /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ea9c310-daaf-4e0c-8742-d21a568551c7 not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:09:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ea9c310-daaf-4e0c-8742-d21a568551c7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:05 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ea9c310-daaf-4e0c-8742-d21a568551c7 Sep 17 15:09:05 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:09 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:09:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Flow 'volume_create_manager' (3c97f637-2003-4fd6-9a20-93d76b01965a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a89321-665f-4264-b7cc-ffba30f9938e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a89321-665f-4264-b7cc-ffba30f9938e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-143106511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f635ad-a257-4893-805b-4a064deae34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624c26544a3e494b9c7ddd1639d150c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:10Z,use_quota=True,user_id='e78fe2808fb047aa81229e4da38a12e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8f218a-7379-47ec-9c4a-592e4de9e61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d8f218a-7379-47ec-9c4a-592e4de9e61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa681ee-ab2b-41c1-adbe-511a6514925e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa681ee-ab2b-41c1-adbe-511a6514925e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4f635ad-a257-4893-805b-4a064deae34c', 'volume_name': 'volume-a4f635ad-a257-4893-805b-4a064deae34c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebf2606-3262-4fbf-a08d-9c3365447757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ebf2606-3262-4fbf-a08d-9c3365447757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92c75a5-2000-481a-94fb-202afcfb7f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:10 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Volume a4f635ad-a257-4893-805b-4a064deae34c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4f635ad-a257-4893-805b-4a064deae34c', 'volume_size': 1} Sep 17 15:09:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:16 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ea9c310-daaf-4e0c-8742-d21a568551c7" returned: 0 in 11.796s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:16 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Image conversion details: src /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751, size 1024.00 MB, duration 11.80 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ea9c310-daaf-4e0c-8742-d21a568551c7 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:09:16 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Converted 1024.00 MB image at 86.80 MB/s Sep 17 15:09:16 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ea9c310-daaf-4e0c-8742-d21a568551c7 is being set with open permissions: ugo+rw Sep 17 15:09:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ea9c310-daaf-4e0c-8742-d21a568551c7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:16 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ea9c310-daaf-4e0c-8742-d21a568551c7 Sep 17 15:09:16 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:17 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ea9c310-daaf-4e0c-8742-d21a568551c7" returned: 0 in 0.330s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Lock "cinder-quobyte-5ea9c310-daaf-4e0c-8742-d21a568551c7" released by "_copy_volume_from_snapshot" :: held 13.823s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Lock "cinder-quobyte-d92e5309-4080-42b8-9f9c-35b82951805f-5ea9c310-daaf-4e0c-8742-d21a568551c7" released by "_create_volume_from_snapshot" :: held 13.919s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.938s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.271s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-143106511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f635ad-a257-4893-805b-4a064deae34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='624c26544a3e494b9c7ddd1639d150c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:10Z,use_quota=True,user_id='e78fe2808fb047aa81229e4da38a12e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Creating volume a4f635ad-a257-4893-805b-4a064deae34c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:09:17 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4f635ad-a257-4893-805b-4a064deae34c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:17 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4f635ad-a257-4893-805b-4a064deae34c 1073741824 Sep 17 15:09:17 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066347b5-3e01-442d-95e6-845f0ad3866e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ea9c310-daaf-4e0c-8742-d21a568551c7', 'volume_size': 1, 'snapshot_id': 'd92e5309-4080-42b8-9f9c-35b82951805f'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b43d60-08d2-47ac-b0da-4a16c2d13681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:17 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Volume volume-5ea9c310-daaf-4e0c-8742-d21a568551c7 (5ea9c310-daaf-4e0c-8742-d21a568551c7): created successfully Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b43d60-08d2-47ac-b0da-4a16c2d13681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Flow 'volume_create_manager' (3b39089e-54da-4c8d-ba68-cf4ef52c76ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:17 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1b52f4eb-0bdb-4262-9bfb-a97e518f31ac tempest-SnapshotDependencyTests-180119662 None] Created volume successfully. Sep 17 15:09:17 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4f635ad-a257-4893-805b-4a064deae34c 1073741824" returned: 0 in 0.513s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4f635ad-a257-4893-805b-4a064deae34c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:17 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4f635ad-a257-4893-805b-4a064deae34c Sep 17 15:09:17 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:18 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4f635ad-a257-4893-805b-4a064deae34c" returned: 0 in 0.386s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:09:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92c75a5-2000-481a-94fb-202afcfb7f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4f635ad-a257-4893-805b-4a064deae34c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a342a9-241c-4b3d-aa02-efadfec5f2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:18 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Volume volume-a4f635ad-a257-4893-805b-4a064deae34c (a4f635ad-a257-4893-805b-4a064deae34c): created successfully Sep 17 15:09:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a342a9-241c-4b3d-aa02-efadfec5f2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Flow 'volume_create_manager' (3c97f637-2003-4fd6-9a20-93d76b01965a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b856db10-659f-4f86-a817-f36aa7c2c915 tempest-TestMinimumBasicScenario-1117358115 None] Created volume successfully. Sep 17 15:09:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] Acquiring lock "cinder-d92e5309-4080-42b8-9f9c-35b82951805f-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] Lock "cinder-d92e5309-4080-42b8-9f9c-35b82951805f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] Acquiring lock "cinder-quobyte-2bf1c856-7483-46be-9f40-b6009c2f6751" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] Lock "cinder-quobyte-2bf1c856-7483-46be-9f40-b6009c2f6751" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] Acquiring lock "cinder-quobyte-d92e5309-4080-42b8-9f9c-35b82951805f" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] Lock "cinder-quobyte-d92e5309-4080-42b8-9f9c-35b82951805f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] Deleting offline snapshot d92e5309-4080-42b8-9f9c-35b82951805f of volume 2bf1c856-7483-46be-9f40-b6009c2f6751 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:09:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] snapshot_file for this snap is: volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:09:18 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bc78d8-37cc-42ed-8bee-0d1893b9b89f]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:18 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f Sep 17 15:09:18 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:19 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f" returned: 0 in 0.502s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bf1c856-7483-46be-9f40-b6009c2f6751(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:09:19 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6adbdba-60e8-4edd-b6d5-acf192e10767]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:19 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 Sep 17 15:09:19 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:19 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751" returned: 0 in 0.785s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:19 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f Sep 17 15:09:19 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-e4f228a8-5140-415c-aa2d-44463cd8f156 req-f8b6fb6d-b388-4573-931b-85c5ca640e61 tempest-TestMinimumBasicScenario-1117358115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-e4f228a8-5140-415c-aa2d-44463cd8f156 req-f8b6fb6d-b388-4573-931b-85c5ca640e61 tempest-TestMinimumBasicScenario-1117358115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-e4f228a8-5140-415c-aa2d-44463cd8f156 req-f8b6fb6d-b388-4573-931b-85c5ca640e61 tempest-TestMinimumBasicScenario-1117358115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-e4f228a8-5140-415c-aa2d-44463cd8f156 req-f8b6fb6d-b388-4573-931b-85c5ca640e61 tempest-TestMinimumBasicScenario-1117358115 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-a4f635ad-a257-4893-805b-4a064deae34c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fa90124-4dc8-46f0-8717-9f9d35442084', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:09:20 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-e4f228a8-5140-415c-aa2d-44463cd8f156 req-f8b6fb6d-b388-4573-931b-85c5ca640e61 tempest-TestMinimumBasicScenario-1117358115 None] attachment_update completed successfully. Sep 17 15:09:20 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f" returned: 0 in 0.592s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:20 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f Sep 17 15:09:20 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:21 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751.d92e5309-4080-42b8-9f9c-35b82951805f" returned: 0 in 0.493s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] Lock "cinder-quobyte-d92e5309-4080-42b8-9f9c-35b82951805f" released by "_delete_snapshot" :: held 2.557s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] Lock "cinder-quobyte-2bf1c856-7483-46be-9f40-b6009c2f6751" released by "delete_snapshot" :: held 2.599s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:21 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] Created reservations ['5dc092d6-f06f-43bf-84d3-a73101635e66', 'e3982dc7-698b-4cf1-8021-bbb957a8c9f0', '856df7ac-cfe5-4c02-8405-3253b02f4729', '7a8a3d44-1dca-4b62-b3d5-3fd9448d66ed'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:09:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] Delete snapshot completed successfully. Sep 17 15:09:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8c73c781-30e5-44df-92de-2ba9b1fa7a74 tempest-SnapshotDependencyTests-180119662 None] Lock "cinder-d92e5309-4080-42b8-9f9c-35b82951805f-delete_snapshot" released by "delete_snapshot" :: held 2.801s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] Acquiring lock "cinder-2bf1c856-7483-46be-9f40-b6009c2f6751-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] Lock "cinder-2bf1c856-7483-46be-9f40-b6009c2f6751-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] Acquiring lock "cinder-quobyte-2bf1c856-7483-46be-9f40-b6009c2f6751" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] Lock "cinder-quobyte-2bf1c856-7483-46be-9f40-b6009c2f6751" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:22 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d2a3f1-c341-447b-9105-6a60cddc0dbf]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:22 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 Sep 17 15:09:22 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:22 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751" returned: 0 in 0.526s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:22 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751 Sep 17 15:09:22 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:22 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2bf1c856-7483-46be-9f40-b6009c2f6751" returned: 0 in 0.301s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] Lock "cinder-quobyte-2bf1c856-7483-46be-9f40-b6009c2f6751" released by "delete_volume" :: held 0.947s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:22 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] Created reservations ['c5473198-a4dc-4574-a1a1-27a14931644a', 'b5d2b1b7-20bd-4a70-ad5c-bc1bb1626141', '6cc6992e-beae-4a72-8623-5fa5c1908927', '5899cac7-3af8-4503-b1b6-10738a10078a'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:09:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:23 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:09:23 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:23 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.286s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:23 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:09:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] Deleted volume successfully. Sep 17 15:09:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3ea6aac2-ad05-4b76-97c4-2ef8fbee41a1 tempest-SnapshotDependencyTests-180119662 None] Lock "cinder-2bf1c856-7483-46be-9f40-b6009c2f6751-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] Acquiring lock "cinder-5ea9c310-daaf-4e0c-8742-d21a568551c7-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] Lock "cinder-5ea9c310-daaf-4e0c-8742-d21a568551c7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] Acquiring lock "cinder-quobyte-5ea9c310-daaf-4e0c-8742-d21a568551c7" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] Lock "cinder-quobyte-5ea9c310-daaf-4e0c-8742-d21a568551c7" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:24 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3cf933-4ed8-457c-8058-79f935cd5867]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ea9c310-daaf-4e0c-8742-d21a568551c7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:24 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ea9c310-daaf-4e0c-8742-d21a568551c7 Sep 17 15:09:24 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:24 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ea9c310-daaf-4e0c-8742-d21a568551c7" returned: 0 in 0.450s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ea9c310-daaf-4e0c-8742-d21a568551c7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:24 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ea9c310-daaf-4e0c-8742-d21a568551c7 Sep 17 15:09:24 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:25 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ea9c310-daaf-4e0c-8742-d21a568551c7" returned: 0 in 0.273s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] Lock "cinder-quobyte-5ea9c310-daaf-4e0c-8742-d21a568551c7" released by "delete_volume" :: held 0.787s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:25 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] Created reservations ['08117b1d-fd85-4a21-bce2-b1756b77c7b4', 'b2c7719c-c856-4823-ab90-009df4d56d55', '24c65eb2-6abb-46fa-81ad-65c16a623a43', '82eaee26-5009-489a-b8eb-7b70596ac536'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:09:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:25 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:09:25 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:25 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.323s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:25 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:09:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] Deleted volume successfully. Sep 17 15:09:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-363bf99c-2cd6-40e7-827a-2135f23cae00 tempest-SnapshotDependencyTests-180119662 None] Lock "cinder-5ea9c310-daaf-4e0c-8742-d21a568551c7-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:35 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=41,cinder:INSERT=7,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:09:35 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=37,cinder:SELECT=25,cinder:INSERT=9,cinder:DELETE=5 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:09:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:09:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:40 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:09:40 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:40 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.290s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:09:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:09:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:09:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Flow 'volume_create_manager' (b8c60d4c-f711-4ad4-b053-a87c81545ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe3245c-ac55-4698-b800-b1320c4c760d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe3245c-ac55-4698-b800-b1320c4c760d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-108126016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa26e41e-4f12-445c-bd1b-de4d12d32e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f4b32e7400435187fa9dc25db28636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:48Z,use_quota=True,user_id='63c06294591a4bf0acf80a18406cc917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c900fee-b6be-4729-8d88-c8ffdf46e5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c900fee-b6be-4729-8d88-c8ffdf46e5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4deaf69b-9d92-4b26-aa51-916a37105a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4deaf69b-9d92-4b26-aa51-916a37105a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa26e41e-4f12-445c-bd1b-de4d12d32e58', 'volume_name': 'volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14ed2b8-a5c1-4093-b8ff-e7aecf38b007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f14ed2b8-a5c1-4093-b8ff-e7aecf38b007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970dcf7f-0574-49ba-a5d4-8978e97ad460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:48 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Volume fa26e41e-4f12-445c-bd1b-de4d12d32e58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58', 'volume_size': 1} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-108126016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa26e41e-4f12-445c-bd1b-de4d12d32e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f4b32e7400435187fa9dc25db28636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:48Z,use_quota=True,user_id='63c06294591a4bf0acf80a18406cc917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Creating volume fa26e41e-4f12-445c-bd1b-de4d12d32e58 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:09:48 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:09:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:48 devstack sudo[101291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 1073741824 Sep 17 15:09:48 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:49 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 1073741824" returned: 0 in 0.768s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:49 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 Sep 17 15:09:49 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:49 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58" returned: 0 in 0.409s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:09:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970dcf7f-0574-49ba-a5d4-8978e97ad460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646595a0-15ed-4220-ac8a-20a7b64a13e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:50 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Volume volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 (fa26e41e-4f12-445c-bd1b-de4d12d32e58): created successfully Sep 17 15:09:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646595a0-15ed-4220-ac8a-20a7b64a13e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Flow 'volume_create_manager' (b8c60d4c-f711-4ad4-b053-a87c81545ea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-727d9750-5d2a-444f-b7b6-53b6777d17e8 tempest-TestStampPattern-888657205 None] Created volume successfully. Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Flow 'volume_create_manager' (ecc5ff63-a379-4705-bd5d-dda0cad11e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8df3f62-023c-4f9a-86d9-dc6ade034253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8df3f62-023c-4f9a-86d9-dc6ade034253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-26888389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b29aa4d-0d29-45b1-aff6-93e2220ab0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55d698abe3f4d09a32b530b9a5c687a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:59Z,use_quota=True,user_id='08a57713535749e4b158292adf4ada4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e35ca3-61ae-4193-b006-142928234c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e35ca3-61ae-4193-b006-142928234c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b993f98-4bef-44e2-9536-c011250fab95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b993f98-4bef-44e2-9536-c011250fab95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b29aa4d-0d29-45b1-aff6-93e2220ab0db', 'volume_name': 'volume-0b29aa4d-0d29-45b1-aff6-93e2220ab0db', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff0f08f-6c2e-4e7f-931b-7b0ae8b94112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff0f08f-6c2e-4e7f-931b-7b0ae8b94112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111b0ebb-17f6-4429-bc82-b427617b0b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:59 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Volume 0b29aa4d-0d29-45b1-aff6-93e2220ab0db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b29aa4d-0d29-45b1-aff6-93e2220ab0db', 'volume_size': 1} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-26888389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b29aa4d-0d29-45b1-aff6-93e2220ab0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55d698abe3f4d09a32b530b9a5c687a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:59Z,use_quota=True,user_id='08a57713535749e4b158292adf4ada4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Creating volume 0b29aa4d-0d29-45b1-aff6-93e2220ab0db {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:09:59 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:09:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0b29aa4d-0d29-45b1-aff6-93e2220ab0db 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:59 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0b29aa4d-0d29-45b1-aff6-93e2220ab0db 1073741824 Sep 17 15:09:59 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:01 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0b29aa4d-0d29-45b1-aff6-93e2220ab0db 1073741824" returned: 0 in 1.344s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0b29aa4d-0d29-45b1-aff6-93e2220ab0db {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:01 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0b29aa4d-0d29-45b1-aff6-93e2220ab0db Sep 17 15:10:01 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:01 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0b29aa4d-0d29-45b1-aff6-93e2220ab0db" returned: 0 in 0.529s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:10:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111b0ebb-17f6-4429-bc82-b427617b0b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b29aa4d-0d29-45b1-aff6-93e2220ab0db', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdc7a03-a567-4591-b53e-0dfdd55131da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:01 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Volume volume-0b29aa4d-0d29-45b1-aff6-93e2220ab0db (0b29aa4d-0d29-45b1-aff6-93e2220ab0db): created successfully Sep 17 15:10:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdc7a03-a567-4591-b53e-0dfdd55131da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Flow 'volume_create_manager' (ecc5ff63-a379-4705-bd5d-dda0cad11e90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:01 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c32c1126-2e7f-46ba-a625-8c449f901d26 tempest-VolumesActionsTest-2122586594 None] Created volume successfully. Sep 17 15:10:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3c45d194-19b1-439b-b38f-afb2d102f4f4 tempest-VolumesActionsTest-2122586594 None] Acquiring lock "cinder-0b29aa4d-0d29-45b1-aff6-93e2220ab0db" by "attach_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3c45d194-19b1-439b-b38f-afb2d102f4f4 tempest-VolumesActionsTest-2122586594 None] Lock "cinder-0b29aa4d-0d29-45b1-aff6-93e2220ab0db" acquired by "attach_volume" :: waited 0.042s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:02 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3c45d194-19b1-439b-b38f-afb2d102f4f4 tempest-VolumesActionsTest-2122586594 None] Attaching volume 0b29aa4d-0d29-45b1-aff6-93e2220ab0db to instance 4fe33921-0f82-4a78-bc91-86c468464867 at mountpoint /dev/vdb on host None. Sep 17 15:10:02 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3c45d194-19b1-439b-b38f-afb2d102f4f4 tempest-VolumesActionsTest-2122586594 None] Attach volume completed successfully. Sep 17 15:10:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3c45d194-19b1-439b-b38f-afb2d102f4f4 tempest-VolumesActionsTest-2122586594 None] Lock "cinder-0b29aa4d-0d29-45b1-aff6-93e2220ab0db" released by "attach_volume" :: held 0.183s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2d2d78d6-31a9-4431-9a08-c82528755b3b tempest-VolumesActionsTest-2110976473 None] Terminate volume connection completed successfully. Sep 17 15:10:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d2d78d6-31a9-4431-9a08-c82528755b3b tempest-VolumesActionsTest-2110976473 None] Acquiring lock "cinder-0b29aa4d-0d29-45b1-aff6-93e2220ab0db-detach_volume" by "detach_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d2d78d6-31a9-4431-9a08-c82528755b3b tempest-VolumesActionsTest-2110976473 None] Lock "cinder-0b29aa4d-0d29-45b1-aff6-93e2220ab0db-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2d2d78d6-31a9-4431-9a08-c82528755b3b tempest-VolumesActionsTest-2110976473 None] Detaching volume 0b29aa4d-0d29-45b1-aff6-93e2220ab0db from instance 4fe33921-0f82-4a78-bc91-86c468464867. Sep 17 15:10:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2d2d78d6-31a9-4431-9a08-c82528755b3b tempest-VolumesActionsTest-2110976473 None] Detach volume completed successfully. Sep 17 15:10:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d2d78d6-31a9-4431-9a08-c82528755b3b tempest-VolumesActionsTest-2110976473 None] Lock "cinder-0b29aa4d-0d29-45b1-aff6-93e2220ab0db-detach_volume" released by "detach_volume" :: held 0.129s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1f4c6489-1ab6-4297-af85-339b87830ee4 tempest-VolumesActionsTest-2122586594 None] Acquiring lock "cinder-0b29aa4d-0d29-45b1-aff6-93e2220ab0db-detach_volume" by "detach_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1f4c6489-1ab6-4297-af85-339b87830ee4 tempest-VolumesActionsTest-2122586594 None] Lock "cinder-0b29aa4d-0d29-45b1-aff6-93e2220ab0db-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:04 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1f4c6489-1ab6-4297-af85-339b87830ee4 tempest-VolumesActionsTest-2122586594 None] Volume detach called, but volume not attached. Sep 17 15:10:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1f4c6489-1ab6-4297-af85-339b87830ee4 tempest-VolumesActionsTest-2122586594 None] Lock "cinder-0b29aa4d-0d29-45b1-aff6-93e2220ab0db-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] Acquiring lock "cinder-0b29aa4d-0d29-45b1-aff6-93e2220ab0db-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] Lock "cinder-0b29aa4d-0d29-45b1-aff6-93e2220ab0db-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] Acquiring lock "cinder-quobyte-0b29aa4d-0d29-45b1-aff6-93e2220ab0db" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] Lock "cinder-quobyte-0b29aa4d-0d29-45b1-aff6-93e2220ab0db" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:04 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e76b31-d98f-4926-90dd-f955c847f9f5]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0b29aa4d-0d29-45b1-aff6-93e2220ab0db {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:05 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0b29aa4d-0d29-45b1-aff6-93e2220ab0db Sep 17 15:10:05 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:05 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0b29aa4d-0d29-45b1-aff6-93e2220ab0db" returned: 0 in 0.657s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0b29aa4d-0d29-45b1-aff6-93e2220ab0db {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:05 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0b29aa4d-0d29-45b1-aff6-93e2220ab0db Sep 17 15:10:05 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:05 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0b29aa4d-0d29-45b1-aff6-93e2220ab0db" returned: 0 in 0.456s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] Lock "cinder-quobyte-0b29aa4d-0d29-45b1-aff6-93e2220ab0db" released by "delete_volume" :: held 1.199s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:06 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] Created reservations ['c88c4d5d-ffea-4179-8efc-a6b2995139b6', 'e7f74b8c-38a3-4721-95c4-6dfb3a78f718', '2e9f5dc1-0ca8-43d9-bfc8-bcbe7cfd8ecf', '4006a831-835b-4f00-999f-ac3496b9c88b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:06 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:10:06 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:06 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.298s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:06 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:06 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] Deleted volume successfully. Sep 17 15:10:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a59366a3-9998-4544-b47b-60e95a564361 tempest-VolumesActionsTest-2122586594 None] Lock "cinder-0b29aa4d-0d29-45b1-aff6-93e2220ab0db-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Flow 'volume_create_manager' (b43ba5cd-6c59-4aa4-a9d6-20cfaf0fc347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3822e4-2239-4d2f-b48f-cc71a38f8234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3822e4-2239-4d2f-b48f-cc71a38f8234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1873254349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24105c49-dc1b-4568-8f71-b9aad65da7ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55d698abe3f4d09a32b530b9a5c687a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:11Z,use_quota=True,user_id='08a57713535749e4b158292adf4ada4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae620ce5-43df-4e75-8c8d-be36cf822e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae620ce5-43df-4e75-8c8d-be36cf822e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6196bce6-06c1-47c7-8619-53f63ef1851b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6196bce6-06c1-47c7-8619-53f63ef1851b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24105c49-dc1b-4568-8f71-b9aad65da7ed', 'volume_name': 'volume-24105c49-dc1b-4568-8f71-b9aad65da7ed', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c349ad-d04f-4342-a858-69e63baf4219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c349ad-d04f-4342-a858-69e63baf4219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f88bf4-70ff-4894-8f16-4d644d58733d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:10 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Volume 24105c49-dc1b-4568-8f71-b9aad65da7ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24105c49-dc1b-4568-8f71-b9aad65da7ed', 'volume_size': 1} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1873254349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24105c49-dc1b-4568-8f71-b9aad65da7ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55d698abe3f4d09a32b530b9a5c687a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:11Z,use_quota=True,user_id='08a57713535749e4b158292adf4ada4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Creating volume 24105c49-dc1b-4568-8f71-b9aad65da7ed {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:10 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:10:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-24105c49-dc1b-4568-8f71-b9aad65da7ed 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:11 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-24105c49-dc1b-4568-8f71-b9aad65da7ed 1073741824 Sep 17 15:10:11 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:11 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-24105c49-dc1b-4568-8f71-b9aad65da7ed 1073741824" returned: 0 in 0.445s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-24105c49-dc1b-4568-8f71-b9aad65da7ed {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:11 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-24105c49-dc1b-4568-8f71-b9aad65da7ed Sep 17 15:10:11 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:11 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-24105c49-dc1b-4568-8f71-b9aad65da7ed" returned: 0 in 0.322s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:10:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f88bf4-70ff-4894-8f16-4d644d58733d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24105c49-dc1b-4568-8f71-b9aad65da7ed', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2dd0428-350d-4a2b-baa7-c1e9e2b680c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:11 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Volume volume-24105c49-dc1b-4568-8f71-b9aad65da7ed (24105c49-dc1b-4568-8f71-b9aad65da7ed): created successfully Sep 17 15:10:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2dd0428-350d-4a2b-baa7-c1e9e2b680c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Flow 'volume_create_manager' (b43ba5cd-6c59-4aa4-a9d6-20cfaf0fc347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3cf1a6c9-5070-43c2-8569-54710e835620 tempest-VolumesActionsTest-2122586594 None] Created volume successfully. Sep 17 15:10:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] Acquiring lock "cinder-24105c49-dc1b-4568-8f71-b9aad65da7ed-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] Lock "cinder-24105c49-dc1b-4568-8f71-b9aad65da7ed-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] Acquiring lock "cinder-quobyte-24105c49-dc1b-4568-8f71-b9aad65da7ed" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] Lock "cinder-quobyte-24105c49-dc1b-4568-8f71-b9aad65da7ed" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:13 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ee76ae-efac-4404-a935-a9edb3ff71ac]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-24105c49-dc1b-4568-8f71-b9aad65da7ed {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:13 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-24105c49-dc1b-4568-8f71-b9aad65da7ed Sep 17 15:10:13 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:13 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-24105c49-dc1b-4568-8f71-b9aad65da7ed" returned: 0 in 0.409s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-24105c49-dc1b-4568-8f71-b9aad65da7ed {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:13 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-24105c49-dc1b-4568-8f71-b9aad65da7ed Sep 17 15:10:13 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:13 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-24105c49-dc1b-4568-8f71-b9aad65da7ed" returned: 0 in 0.267s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] Lock "cinder-quobyte-24105c49-dc1b-4568-8f71-b9aad65da7ed" released by "delete_volume" :: held 0.729s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:14 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] Created reservations ['39db14ec-0839-4fcc-ae3a-88029e4194e1', '0125da5d-60ac-4cb0-97b5-b637c18586f9', '5411c631-9fd3-4a34-b495-7b1367737368', '9583e002-1f28-4968-855a-38c246705944'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:14 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:10:14 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:14 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.264s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:14 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] Deleted volume successfully. Sep 17 15:10:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f841dac1-4d00-4599-bec0-85e19f27cfa1 tempest-VolumesActionsTest-2110976473 None] Lock "cinder-24105c49-dc1b-4568-8f71-b9aad65da7ed-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:14 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Flow 'volume_create_manager' (ccc7a11d-b601-4d66-82d1-0d415c46ffdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74487ee-46e0-43ca-8359-b40d2f85a3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74487ee-46e0-43ca-8359-b40d2f85a3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2086222762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a316a7-1f03-463e-b7ef-98991ba460ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55d698abe3f4d09a32b530b9a5c687a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:15Z,use_quota=True,user_id='08a57713535749e4b158292adf4ada4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8b8ab2-cd66-43cf-a95d-580f451949fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8b8ab2-cd66-43cf-a95d-580f451949fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fb0004-f02e-46cd-8e1e-7e0a939498b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65fb0004-f02e-46cd-8e1e-7e0a939498b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00a316a7-1f03-463e-b7ef-98991ba460ab', 'volume_name': 'volume-00a316a7-1f03-463e-b7ef-98991ba460ab', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08606c3-cdaf-4666-805f-8ac5f8c045ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08606c3-cdaf-4666-805f-8ac5f8c045ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ac95ed-a847-4559-9bff-94d4ff4a50bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:15 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Volume 00a316a7-1f03-463e-b7ef-98991ba460ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00a316a7-1f03-463e-b7ef-98991ba460ab', 'volume_size': 1} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2086222762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a316a7-1f03-463e-b7ef-98991ba460ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55d698abe3f4d09a32b530b9a5c687a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:15Z,use_quota=True,user_id='08a57713535749e4b158292adf4ada4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Creating volume 00a316a7-1f03-463e-b7ef-98991ba460ab {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:15 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00a316a7-1f03-463e-b7ef-98991ba460ab 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:15 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00a316a7-1f03-463e-b7ef-98991ba460ab 1073741824 Sep 17 15:10:15 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:15 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00a316a7-1f03-463e-b7ef-98991ba460ab 1073741824" returned: 0 in 0.459s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00a316a7-1f03-463e-b7ef-98991ba460ab {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:15 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00a316a7-1f03-463e-b7ef-98991ba460ab Sep 17 15:10:15 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:15 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00a316a7-1f03-463e-b7ef-98991ba460ab" returned: 0 in 0.247s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ac95ed-a847-4559-9bff-94d4ff4a50bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a316a7-1f03-463e-b7ef-98991ba460ab', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c6221c3-358d-4022-af84-a6798c3e6c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:15 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Volume volume-00a316a7-1f03-463e-b7ef-98991ba460ab (00a316a7-1f03-463e-b7ef-98991ba460ab): created successfully Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c6221c3-358d-4022-af84-a6798c3e6c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Flow 'volume_create_manager' (ccc7a11d-b601-4d66-82d1-0d415c46ffdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1d557284-6207-4e61-bc49-61aeffb897f6 tempest-VolumesActionsTest-2122586594 None] Created volume successfully. Sep 17 15:10:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] Acquiring lock "cinder-00a316a7-1f03-463e-b7ef-98991ba460ab-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] Lock "cinder-00a316a7-1f03-463e-b7ef-98991ba460ab-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] Acquiring lock "cinder-quobyte-00a316a7-1f03-463e-b7ef-98991ba460ab" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] Lock "cinder-quobyte-00a316a7-1f03-463e-b7ef-98991ba460ab" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:17 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2c6ef0-509e-4830-a997-0474a62d4578]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00a316a7-1f03-463e-b7ef-98991ba460ab {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:17 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00a316a7-1f03-463e-b7ef-98991ba460ab Sep 17 15:10:17 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:17 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00a316a7-1f03-463e-b7ef-98991ba460ab" returned: 0 in 0.355s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00a316a7-1f03-463e-b7ef-98991ba460ab {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:17 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00a316a7-1f03-463e-b7ef-98991ba460ab Sep 17 15:10:17 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:17 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00a316a7-1f03-463e-b7ef-98991ba460ab" returned: 0 in 0.256s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] Lock "cinder-quobyte-00a316a7-1f03-463e-b7ef-98991ba460ab" released by "delete_volume" :: held 0.648s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:17 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] Created reservations ['9a713d2b-798a-4bc8-8b4b-c382605ebaa6', '51aaecb6-ee69-4ede-8c8e-8a6acafc31b4', '01c95278-20bb-4b49-9c7b-592c73e695c5', '78a23bd3-fcb3-4090-bd06-314e800542b8'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:18 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:10:18 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:18 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.245s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] Deleted volume successfully. Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-527d5281-9318-4329-ba18-d52e25bad59c tempest-VolumesActionsTest-2110976473 None] Lock "cinder-00a316a7-1f03-463e-b7ef-98991ba460ab-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Flow 'volume_create_manager' (4b1bd970-ffe1-4a06-930c-f09fae8035dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2bf33aa-2e07-4343-a6ce-1dbe6ea6be8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2bf33aa-2e07-4343-a6ce-1dbe6ea6be8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1967437770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76966292-18ba-41d6-b0c4-9277a1d1133d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55d698abe3f4d09a32b530b9a5c687a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:19Z,use_quota=True,user_id='08a57713535749e4b158292adf4ada4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89ffefc-5409-4683-aba0-e455083105c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89ffefc-5409-4683-aba0-e455083105c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d88ff3-4792-47ab-a1f9-e3c281fe98cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d88ff3-4792-47ab-a1f9-e3c281fe98cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76966292-18ba-41d6-b0c4-9277a1d1133d', 'volume_name': 'volume-76966292-18ba-41d6-b0c4-9277a1d1133d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f975590-1a31-48b5-a0cb-6e3a5db7d1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f975590-1a31-48b5-a0cb-6e3a5db7d1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df1d92a-8a2a-4b60-85c6-ba635f1850bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:18 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Volume 76966292-18ba-41d6-b0c4-9277a1d1133d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76966292-18ba-41d6-b0c4-9277a1d1133d', 'volume_size': 1} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1967437770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76966292-18ba-41d6-b0c4-9277a1d1133d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55d698abe3f4d09a32b530b9a5c687a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:19Z,use_quota=True,user_id='08a57713535749e4b158292adf4ada4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Creating volume 76966292-18ba-41d6-b0c4-9277a1d1133d {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:18 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:10:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76966292-18ba-41d6-b0c4-9277a1d1133d 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:18 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76966292-18ba-41d6-b0c4-9277a1d1133d 1073741824 Sep 17 15:10:18 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:19 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76966292-18ba-41d6-b0c4-9277a1d1133d 1073741824" returned: 0 in 0.422s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76966292-18ba-41d6-b0c4-9277a1d1133d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:19 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76966292-18ba-41d6-b0c4-9277a1d1133d Sep 17 15:10:19 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:19 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76966292-18ba-41d6-b0c4-9277a1d1133d" returned: 0 in 0.242s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:10:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df1d92a-8a2a-4b60-85c6-ba635f1850bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76966292-18ba-41d6-b0c4-9277a1d1133d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bfcf0ab-d9f8-4675-b029-44969c10dd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:19 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Volume volume-76966292-18ba-41d6-b0c4-9277a1d1133d (76966292-18ba-41d6-b0c4-9277a1d1133d): created successfully Sep 17 15:10:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bfcf0ab-d9f8-4675-b029-44969c10dd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Flow 'volume_create_manager' (4b1bd970-ffe1-4a06-930c-f09fae8035dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:19 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a6e12e59-b0e4-4d85-86da-da7927bf68bd tempest-VolumesActionsTest-2122586594 None] Created volume successfully. Sep 17 15:10:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] Acquiring lock "cinder-76966292-18ba-41d6-b0c4-9277a1d1133d-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] Lock "cinder-76966292-18ba-41d6-b0c4-9277a1d1133d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] Acquiring lock "cinder-quobyte-76966292-18ba-41d6-b0c4-9277a1d1133d" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] Lock "cinder-quobyte-76966292-18ba-41d6-b0c4-9277a1d1133d" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:20 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2e7bd7-71d8-499d-a1a1-b32bea84f4ba]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76966292-18ba-41d6-b0c4-9277a1d1133d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:20 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76966292-18ba-41d6-b0c4-9277a1d1133d Sep 17 15:10:20 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:20 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76966292-18ba-41d6-b0c4-9277a1d1133d" returned: 0 in 0.356s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76966292-18ba-41d6-b0c4-9277a1d1133d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:20 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76966292-18ba-41d6-b0c4-9277a1d1133d Sep 17 15:10:20 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:20 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-76966292-18ba-41d6-b0c4-9277a1d1133d" returned: 0 in 0.239s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] Lock "cinder-quobyte-76966292-18ba-41d6-b0c4-9277a1d1133d" released by "delete_volume" :: held 0.636s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:20 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] Created reservations ['ad483350-e1a5-43b7-9613-13d0dc6498cf', '8a911e74-73df-40d6-916d-9d262709261c', '7301f587-065a-4fde-92eb-486afdcf13c1', 'bac2cba1-888a-4066-a9ca-d932d7d00dff'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:20 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:10:20 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:21 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.238s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] Deleted volume successfully. Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-00f5131a-f3f3-4907-8a43-7d1f96b2848e tempest-VolumesActionsTest-2110976473 None] Lock "cinder-76966292-18ba-41d6-b0c4-9277a1d1133d-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Flow 'volume_create_manager' (117f7290-4274-4738-a6ff-8163e7420693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e29eae-9a2f-47ff-9942-aac17c0953fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e29eae-9a2f-47ff-9942-aac17c0953fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1051830099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e913f86d-c6a9-4c3e-9f79-df2a02e75e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55d698abe3f4d09a32b530b9a5c687a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:22Z,use_quota=True,user_id='08a57713535749e4b158292adf4ada4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c981d2-9b35-4fd0-83b8-9154258dad70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c981d2-9b35-4fd0-83b8-9154258dad70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856ea17a-6757-46d4-8364-99aff00da12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856ea17a-6757-46d4-8364-99aff00da12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e913f86d-c6a9-4c3e-9f79-df2a02e75e0b', 'volume_name': 'volume-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed7434f-76ac-4623-9b84-50a467207156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed7434f-76ac-4623-9b84-50a467207156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc037c59-54c2-4da9-9e03-643cf5c8152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:21 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Volume e913f86d-c6a9-4c3e-9f79-df2a02e75e0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b', 'volume_size': 1} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1051830099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e913f86d-c6a9-4c3e-9f79-df2a02e75e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55d698abe3f4d09a32b530b9a5c687a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:22Z,use_quota=True,user_id='08a57713535749e4b158292adf4ada4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Creating volume e913f86d-c6a9-4c3e-9f79-df2a02e75e0b {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:21 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:10:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:21 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b 1073741824 Sep 17 15:10:21 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:22 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b 1073741824" returned: 0 in 0.401s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:22 devstack sudo[101688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b Sep 17 15:10:22 devstack sudo[101688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:22 devstack sudo[101688]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b" returned: 0 in 0.252s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:10:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc037c59-54c2-4da9-9e03-643cf5c8152a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b82d9a02-8bfb-46a5-93cd-a22752975926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:22 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Volume volume-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b (e913f86d-c6a9-4c3e-9f79-df2a02e75e0b): created successfully Sep 17 15:10:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b82d9a02-8bfb-46a5-93cd-a22752975926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Flow 'volume_create_manager' (117f7290-4274-4738-a6ff-8163e7420693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-49f587a4-9644-4f22-b8b5-6d40ba2bc1f3 tempest-VolumesActionsTest-2122586594 None] Created volume successfully. Sep 17 15:10:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] Acquiring lock "cinder-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] Lock "cinder-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] Acquiring lock "cinder-quobyte-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] Lock "cinder-quobyte-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b" acquired by "delete_volume" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:22 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[9441a8af-45db-4f91-8f47-ebbc4b4f8a7d]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:22 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b Sep 17 15:10:22 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:23 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b" returned: 0 in 0.387s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:23 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b Sep 17 15:10:23 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:23 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b" returned: 0 in 0.288s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] Lock "cinder-quobyte-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b" released by "delete_volume" :: held 0.723s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:23 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] Created reservations ['1bd2613b-c592-45e4-b24b-bd9cf9485025', '86a62f54-a8db-4c33-ac09-f8a44564e385', '29cdc4fd-6066-4515-8eb9-f099094c8b5f', 'deb08043-144b-4e42-a23b-a4f07fd41812'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:23 devstack sudo[101699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:10:23 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:23 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.258s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:23 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] Deleted volume successfully. Sep 17 15:10:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cdb7ecc4-74a8-4602-acfa-1c8c4ed38250 tempest-VolumesActionsTest-2110976473 None] Lock "cinder-e913f86d-c6a9-4c3e-9f79-df2a02e75e0b-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Flow 'volume_create_manager' (7ce2158e-fb66-409d-adc1-4c3fb01d35ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2910589b-d620-4f33-94d2-920a9e361b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2910589b-d620-4f33-94d2-920a9e361b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-722356685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae3c354-b137-4741-a9ec-85905ae9d69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55d698abe3f4d09a32b530b9a5c687a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:24Z,use_quota=True,user_id='08a57713535749e4b158292adf4ada4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeed6f20-301c-4cec-a67f-ea5ebee6ffbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeed6f20-301c-4cec-a67f-ea5ebee6ffbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5839820e-427c-40e6-886d-bcc7b354e6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5839820e-427c-40e6-886d-bcc7b354e6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ae3c354-b137-4741-a9ec-85905ae9d69b', 'volume_name': 'volume-5ae3c354-b137-4741-a9ec-85905ae9d69b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158aa0fc-3522-41a1-8c4f-cced75fee920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158aa0fc-3522-41a1-8c4f-cced75fee920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa06fff-94b0-49c2-a4dd-876f0581045d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:24 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Volume 5ae3c354-b137-4741-a9ec-85905ae9d69b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ae3c354-b137-4741-a9ec-85905ae9d69b', 'volume_size': 1} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-722356685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ae3c354-b137-4741-a9ec-85905ae9d69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55d698abe3f4d09a32b530b9a5c687a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:24Z,use_quota=True,user_id='08a57713535749e4b158292adf4ada4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Creating volume 5ae3c354-b137-4741-a9ec-85905ae9d69b {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:24 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ae3c354-b137-4741-a9ec-85905ae9d69b 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:24 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ae3c354-b137-4741-a9ec-85905ae9d69b 1073741824 Sep 17 15:10:24 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:24 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ae3c354-b137-4741-a9ec-85905ae9d69b 1073741824" returned: 0 in 0.402s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ae3c354-b137-4741-a9ec-85905ae9d69b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:25 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ae3c354-b137-4741-a9ec-85905ae9d69b Sep 17 15:10:25 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:25 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ae3c354-b137-4741-a9ec-85905ae9d69b" returned: 0 in 0.256s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:10:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa06fff-94b0-49c2-a4dd-876f0581045d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ae3c354-b137-4741-a9ec-85905ae9d69b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d8c57a-43f7-4dfb-9ea2-d1ab4f9b7e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:25 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Volume volume-5ae3c354-b137-4741-a9ec-85905ae9d69b (5ae3c354-b137-4741-a9ec-85905ae9d69b): created successfully Sep 17 15:10:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d8c57a-43f7-4dfb-9ea2-d1ab4f9b7e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Flow 'volume_create_manager' (7ce2158e-fb66-409d-adc1-4c3fb01d35ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2bf90a5d-c899-4358-9341-4d13ec60e1ea tempest-VolumesActionsTest-2122586594 None] Created volume successfully. Sep 17 15:10:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] Acquiring lock "cinder-5ae3c354-b137-4741-a9ec-85905ae9d69b-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] Lock "cinder-5ae3c354-b137-4741-a9ec-85905ae9d69b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] Acquiring lock "cinder-quobyte-5ae3c354-b137-4741-a9ec-85905ae9d69b" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] Lock "cinder-quobyte-5ae3c354-b137-4741-a9ec-85905ae9d69b" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:26 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[448fb006-7520-4429-89a0-a242c9e249ec]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ae3c354-b137-4741-a9ec-85905ae9d69b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:26 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ae3c354-b137-4741-a9ec-85905ae9d69b Sep 17 15:10:26 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:26 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ae3c354-b137-4741-a9ec-85905ae9d69b" returned: 0 in 0.366s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ae3c354-b137-4741-a9ec-85905ae9d69b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:26 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ae3c354-b137-4741-a9ec-85905ae9d69b Sep 17 15:10:26 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:26 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5ae3c354-b137-4741-a9ec-85905ae9d69b" returned: 0 in 0.256s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] Lock "cinder-quobyte-5ae3c354-b137-4741-a9ec-85905ae9d69b" released by "delete_volume" :: held 0.660s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:26 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] Created reservations ['ab414929-3a98-457f-a8d0-b3efc0a158b8', '69c76d48-4ca9-4a0e-8776-d82bbdbcc061', '5a622ee8-f438-418e-a6d3-f1f76280dd89', 'e6f6c4ca-02b5-425c-8c4c-64234141605f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:26 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:10:26 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:27 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.249s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:27 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] Deleted volume successfully. Sep 17 15:10:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b37ca37a-87d7-4319-902f-46eb1fe95f4f tempest-VolumesActionsTest-2122586594 None] Lock "cinder-5ae3c354-b137-4741-a9ec-85905ae9d69b-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-7efb3e83-df24-4abb-b9dc-a031c718dd72 req-fd82ee8f-3f44-431b-85a9-d98a474c880d tempest-TestStampPattern-888657205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-7efb3e83-df24-4abb-b9dc-a031c718dd72 req-fd82ee8f-3f44-431b-85a9-d98a474c880d tempest-TestStampPattern-888657205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-7efb3e83-df24-4abb-b9dc-a031c718dd72 req-fd82ee8f-3f44-431b-85a9-d98a474c880d tempest-TestStampPattern-888657205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-7efb3e83-df24-4abb-b9dc-a031c718dd72 req-fd82ee8f-3f44-431b-85a9-d98a474c880d tempest-TestStampPattern-888657205 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6b3dc08-0b42-4ea5-94f4-b72c82acb708', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:10:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-7efb3e83-df24-4abb-b9dc-a031c718dd72 req-fd82ee8f-3f44-431b-85a9-d98a474c880d tempest-TestStampPattern-888657205 None] attachment_update completed successfully. Sep 17 15:10:32 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-7fa93b1b-f85d-4dc6-ba67-bf895881d31a req-9e86e8dd-bf31-4cd9-90ca-eabd5bf59809 tempest-TestStampPattern-888657205 None] Terminate volume connection completed successfully. Sep 17 15:10:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-7fa93b1b-f85d-4dc6-ba67-bf895881d31a req-9e86e8dd-bf31-4cd9-90ca-eabd5bf59809 tempest-TestStampPattern-888657205 None] Deleting attachment f6b3dc08-0b42-4ea5-94f4-b72c82acb708. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:10:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] Creating offline snapshot 8edd964d-7572-4d02-a52b-17fb2f0ee67e of volume fa26e41e-4f12-445c-bd1b-de4d12d32e58 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:10:33 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[270c3464-9800-42cd-9430-ce307b6b7488]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:33 devstack sudo[101764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 Sep 17 15:10:33 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:33 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58" returned: 0 in 0.375s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:33 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e 1G Sep 17 15:10:33 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:34 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e 1G" returned: 0 in 0.433s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:34 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e Sep 17 15:10:34 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:34 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e" returned: 0 in 0.279s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:34 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e is being set with open permissions: ugo+rw Sep 17 15:10:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:34 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e Sep 17 15:10:34 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:34 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e" returned: 0 in 0.255s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:34 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.info Sep 17 15:10:34 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:35 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.info" returned: 0 in 0.291s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:35 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.info is being set with open permissions: ugo+rw Sep 17 15:10:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:35 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.info Sep 17 15:10:35 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:35 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.info" returned: 0 in 0.259s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.998s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:35 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4b7212a7-67fd-489e-9930-c2ee040b7d8a tempest-TestStampPattern-888657205 None] Create snapshot completed successfully Sep 17 15:10:39 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-1cfe421d-3ca5-47c8-96f1-bae3eebccf59 req-fc70d246-d739-4a7a-bef7-ba0299cbba75 tempest-TestMinimumBasicScenario-1117358115 None] Terminate volume connection completed successfully. Sep 17 15:10:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-1cfe421d-3ca5-47c8-96f1-bae3eebccf59 req-fc70d246-d739-4a7a-bef7-ba0299cbba75 tempest-TestMinimumBasicScenario-1117358115 None] Deleting attachment 8fa90124-4dc8-46f0-8717-9f9d35442084. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] Acquiring lock "cinder-a4f635ad-a257-4893-805b-4a064deae34c-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] Lock "cinder-a4f635ad-a257-4893-805b-4a064deae34c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] Acquiring lock "cinder-quobyte-a4f635ad-a257-4893-805b-4a064deae34c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] Lock "cinder-quobyte-a4f635ad-a257-4893-805b-4a064deae34c" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4df1553-8829-4b6b-aa67-87beb50f3730]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4f635ad-a257-4893-805b-4a064deae34c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:40 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:10:40 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:40 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4f635ad-a257-4893-805b-4a064deae34c Sep 17 15:10:40 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:40 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.359s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Flow 'volume_create_manager' (253e1908-d0dd-42ce-ac12-c5d6f51d84cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54490785-0e4e-43bf-bfd5-692f4fceda5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54490785-0e4e-43bf-bfd5-692f4fceda5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-883297240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d4315f-363f-4601-892e-73b47a5126bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='874e8530b0e14ac99817ddfeb34e9374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:41Z,use_quota=True,user_id='b4a63de0dfe64f5c976e80f01141360c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d585a350-a69c-4f51-b8a2-3af63734e6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d585a350-a69c-4f51-b8a2-3af63734e6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bbb847-2018-40ca-abe5-426b213329f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bbb847-2018-40ca-abe5-426b213329f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6d4315f-363f-4601-892e-73b47a5126bb', 'volume_name': 'volume-f6d4315f-363f-4601-892e-73b47a5126bb', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad896a9-66b9-49af-a0d8-c66a750be48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad896a9-66b9-49af-a0d8-c66a750be48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7148e1a7-ffba-45d0-bbe5-a918a6774c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:40 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Volume f6d4315f-363f-4601-892e-73b47a5126bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6d4315f-363f-4601-892e-73b47a5126bb', 'volume_size': 1} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-883297240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d4315f-363f-4601-892e-73b47a5126bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='874e8530b0e14ac99817ddfeb34e9374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:41Z,use_quota=True,user_id='b4a63de0dfe64f5c976e80f01141360c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Creating volume f6d4315f-363f-4601-892e-73b47a5126bb {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:40 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:40 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4f635ad-a257-4893-805b-4a064deae34c" returned: 0 in 0.511s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4f635ad-a257-4893-805b-4a064deae34c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:40 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb 1073741824 Sep 17 15:10:40 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:40 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4f635ad-a257-4893-805b-4a064deae34c Sep 17 15:10:40 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:41 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a4f635ad-a257-4893-805b-4a064deae34c" returned: 0 in 0.283s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] Lock "cinder-quobyte-a4f635ad-a257-4893-805b-4a064deae34c" released by "delete_volume" :: held 0.887s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] Created reservations ['b604667b-8a2d-479f-a1e1-e4b24fdfa374', 'ffb2b64f-2c77-4bee-86e7-37af94627ac4', '7a9a8a48-1679-45d4-b680-6eb8936efab7', '7d381235-0a74-4ce0-90f2-a231a3ad37cc'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:41 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:10:41 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb 1073741824" returned: 0 in 0.508s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:41 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:41 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb Sep 17 15:10:41 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:41 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.329s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] Deleted volume successfully. Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6bf1639e-b50a-441a-996b-3464d5604364 tempest-TestMinimumBasicScenario-1117358115 None] Lock "cinder-a4f635ad-a257-4893-805b-4a064deae34c-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:41 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb" returned: 0 in 0.351s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7148e1a7-ffba-45d0-bbe5-a918a6774c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6d4315f-363f-4601-892e-73b47a5126bb', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b99b3b7-978a-4294-99ac-32a0fabebed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:41 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Volume volume-f6d4315f-363f-4601-892e-73b47a5126bb (f6d4315f-363f-4601-892e-73b47a5126bb): created successfully Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b99b3b7-978a-4294-99ac-32a0fabebed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Flow 'volume_create_manager' (253e1908-d0dd-42ce-ac12-c5d6f51d84cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c2e404d4-2209-4980-910d-c14729f5f4dd tempest-SnapshotMetadataTestJSON-1205283466 None] Created volume successfully. Sep 17 15:10:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] Creating offline snapshot 02e912e6-9f67-40d8-b2d5-5eaf9528e27d of volume f6d4315f-363f-4601-892e-73b47a5126bb {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:10:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db60870-9360-4608-9a50-a63d099c6482]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:43 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb Sep 17 15:10:43 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:43 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb" returned: 0 in 0.452s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:43 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d 1G Sep 17 15:10:43 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:44 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d 1G" returned: 0 in 0.440s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d4315f-363f-4601-892e-73b47a5126bb -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:44 devstack sudo[101881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d4315f-363f-4601-892e-73b47a5126bb -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d Sep 17 15:10:44 devstack sudo[101881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:44 devstack sudo[101881]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d4315f-363f-4601-892e-73b47a5126bb -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d" returned: 0 in 0.375s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:44 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d is being set with open permissions: ugo+rw Sep 17 15:10:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:44 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d Sep 17 15:10:44 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:44 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d" returned: 0 in 0.291s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:44 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Flow 'volume_create_manager' (3d528542-6f7a-497b-9e9d-9b0f7a9fca97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f041808d-3226-4ad6-8d97-73cff5f2d740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f041808d-3226-4ad6-8d97-73cff5f2d740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-219861795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a974ac55-0464-4209-a8ae-03a2c95ccc67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38f4b32e7400435187fa9dc25db28636',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8edd964d-7572-4d02-a52b-17fb2f0ee67e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:45Z,use_quota=True,user_id='63c06294591a4bf0acf80a18406cc917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90413c30-d802-4418-b0ac-18587a8ffdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90413c30-d802-4418-b0ac-18587a8ffdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60267227-fef9-4ff7-b700-bddaec29c8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60267227-fef9-4ff7-b700-bddaec29c8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a974ac55-0464-4209-a8ae-03a2c95ccc67', 'volume_name': 'volume-a974ac55-0464-4209-a8ae-03a2c95ccc67', 'volume_size': 1, 'snapshot_id': '8edd964d-7572-4d02-a52b-17fb2f0ee67e'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc40d20-23b5-4179-8a9a-da9e7dd17df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dc40d20-23b5-4179-8a9a-da9e7dd17df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035fd004-6997-49bc-83d5-81d302079ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:45 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Volume a974ac55-0464-4209-a8ae-03a2c95ccc67: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a974ac55-0464-4209-a8ae-03a2c95ccc67', 'volume_size': 1, 'snapshot_id': '8edd964d-7572-4d02-a52b-17fb2f0ee67e'} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:45 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.info Sep 17 15:10:45 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:45 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.info" returned: 0 in 0.293s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:45 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.info is being set with open permissions: ugo+rw Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:45 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.info Sep 17 15:10:45 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:45 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.info" returned: 0 in 0.293s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.382s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.607s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Acquiring lock "cinder-quobyte-8edd964d-7572-4d02-a52b-17fb2f0ee67e-a974ac55-0464-4209-a8ae-03a2c95ccc67" by "_create_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=90,cinder:SELECT=78,cinder:INSERT=20,cinder:DELETE=9 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=74,cinder:UPDATE=88,cinder:DELETE=7,cinder:INSERT=20 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Lock "cinder-quobyte-8edd964d-7572-4d02-a52b-17fb2f0ee67e-a974ac55-0464-4209-a8ae-03a2c95ccc67" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Creating volume a974ac55-0464-4209-a8ae-03a2c95ccc67 from snapshot 8edd964d-7572-4d02-a52b-17fb2f0ee67e {{(pid=86082) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Acquiring lock "cinder-quobyte-a974ac55-0464-4209-a8ae-03a2c95ccc67" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e62c3ffd-7a39-42ba-a94e-1abcd88b22a0 tempest-SnapshotMetadataTestJSON-1205283466 None] Create snapshot completed successfully Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Lock "cinder-quobyte-a974ac55-0464-4209-a8ae-03a2c95ccc67" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] snapshot: 8edd964d-7572-4d02-a52b-17fb2f0ee67e, volume: a974ac55-0464-4209-a8ae-03a2c95ccc67, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b77928c-dff8-4a1e-9f55-b9510c4deeb5]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:45 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e Sep 17 15:10:45 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:46 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e" returned: 0 in 0.430s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:10:46 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bb8e5e-3770-4769-a8d4-617cab70bbc3]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:46 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 Sep 17 15:10:46 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:46 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58" returned: 0 in 0.564s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:10:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:10:46 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Path /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a974ac55-0464-4209-a8ae-03a2c95ccc67 not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:10:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a974ac55-0464-4209-a8ae-03a2c95ccc67 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:46 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a974ac55-0464-4209-a8ae-03a2c95ccc67 Sep 17 15:10:46 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] Acquiring lock "cinder-02e912e6-9f67-40d8-b2d5-5eaf9528e27d-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] Lock "cinder-02e912e6-9f67-40d8-b2d5-5eaf9528e27d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] Acquiring lock "cinder-quobyte-f6d4315f-363f-4601-892e-73b47a5126bb" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] Lock "cinder-quobyte-f6d4315f-363f-4601-892e-73b47a5126bb" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] Acquiring lock "cinder-quobyte-02e912e6-9f67-40d8-b2d5-5eaf9528e27d" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] Lock "cinder-quobyte-02e912e6-9f67-40d8-b2d5-5eaf9528e27d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] Deleting offline snapshot 02e912e6-9f67-40d8-b2d5-5eaf9528e27d of volume f6d4315f-363f-4601-892e-73b47a5126bb {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:10:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] snapshot_file for this snap is: volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:10:47 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[830db871-010a-408a-9b5f-656ae46062a9]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:47 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d Sep 17 15:10:47 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:48 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d" returned: 0 in 0.947s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6d4315f-363f-4601-892e-73b47a5126bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:10:48 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2bbd37-189e-4225-af9a-9b9f253926c0]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:49 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb Sep 17 15:10:49 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:49 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb" returned: 0 in 0.888s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:49 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d Sep 17 15:10:49 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:51 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d" returned: 0 in 1.499s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:51 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d Sep 17 15:10:51 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:51 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb.02e912e6-9f67-40d8-b2d5-5eaf9528e27d" returned: 0 in 0.666s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] Lock "cinder-quobyte-02e912e6-9f67-40d8-b2d5-5eaf9528e27d" released by "_delete_snapshot" :: held 4.317s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] Lock "cinder-quobyte-f6d4315f-363f-4601-892e-73b47a5126bb" released by "delete_snapshot" :: held 4.371s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:52 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] Created reservations ['3a4ebd7e-fdc5-4177-862a-d7246cf2e52f', '84d5d207-d548-4636-8606-955459566d5a', '42169b93-a421-434a-8ccc-ff62c8a4c65a', 'e320dd7a-f2a1-49c9-af78-b17801532d67'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] Delete snapshot completed successfully. Sep 17 15:10:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0373085-0273-4a19-b38a-f4efbc32287f tempest-SnapshotMetadataTestJSON-1205283466 None] Lock "cinder-02e912e6-9f67-40d8-b2d5-5eaf9528e27d-delete_snapshot" released by "delete_snapshot" :: held 4.723s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] Acquiring lock "cinder-f6d4315f-363f-4601-892e-73b47a5126bb-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] Lock "cinder-f6d4315f-363f-4601-892e-73b47a5126bb-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] Acquiring lock "cinder-quobyte-f6d4315f-363f-4601-892e-73b47a5126bb" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] Lock "cinder-quobyte-f6d4315f-363f-4601-892e-73b47a5126bb" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:54 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69178f6-a403-447c-bef3-22fa78cd3885]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:54 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb Sep 17 15:10:54 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:54 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb" returned: 0 in 0.915s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:55 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb Sep 17 15:10:55 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:55 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f6d4315f-363f-4601-892e-73b47a5126bb" returned: 0 in 0.720s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] Lock "cinder-quobyte-f6d4315f-363f-4601-892e-73b47a5126bb" released by "delete_volume" :: held 1.835s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:55 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] Created reservations ['dc445700-cfb1-49e6-8335-7ab9fcb7df8c', '624f8621-8e9b-4f3e-83d5-44875896e62d', '4e84d9e8-0f7d-45e7-b76a-501dc8f431dc', '6eb13146-1a13-43db-b274-9dbb342ec7f7'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:56 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:10:56 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:56 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.689s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:56 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:56 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] Deleted volume successfully. Sep 17 15:10:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-78e134d2-f4c4-493a-b0d9-5c2336fe6126 tempest-SnapshotMetadataTestJSON-1205283466 None] Lock "cinder-f6d4315f-363f-4601-892e-73b47a5126bb-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:57 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a974ac55-0464-4209-a8ae-03a2c95ccc67" returned: 0 in 10.864s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:57 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Image conversion details: src /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58, size 1024.00 MB, duration 10.86 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a974ac55-0464-4209-a8ae-03a2c95ccc67 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:10:57 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Converted 1024.00 MB image at 94.25 MB/s Sep 17 15:10:57 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a974ac55-0464-4209-a8ae-03a2c95ccc67 is being set with open permissions: ugo+rw Sep 17 15:10:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a974ac55-0464-4209-a8ae-03a2c95ccc67 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:57 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a974ac55-0464-4209-a8ae-03a2c95ccc67 Sep 17 15:10:57 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:58 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a974ac55-0464-4209-a8ae-03a2c95ccc67" returned: 0 in 0.360s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Lock "cinder-quobyte-a974ac55-0464-4209-a8ae-03a2c95ccc67" released by "_copy_volume_from_snapshot" :: held 12.349s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Lock "cinder-quobyte-8edd964d-7572-4d02-a52b-17fb2f0ee67e-a974ac55-0464-4209-a8ae-03a2c95ccc67" released by "_create_volume_from_snapshot" :: held 12.464s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.511s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (035fd004-6997-49bc-83d5-81d302079ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a974ac55-0464-4209-a8ae-03a2c95ccc67', 'volume_size': 1, 'snapshot_id': '8edd964d-7572-4d02-a52b-17fb2f0ee67e'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb1bf7f-e094-4aa6-9e0a-39ac05788e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:58 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Volume volume-a974ac55-0464-4209-a8ae-03a2c95ccc67 (a974ac55-0464-4209-a8ae-03a2c95ccc67): created successfully Sep 17 15:10:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb1bf7f-e094-4aa6-9e0a-39ac05788e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Flow 'volume_create_manager' (3d528542-6f7a-497b-9e9d-9b0f7a9fca97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:58 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-727e856c-cd93-43f7-b578-b18909be5b20 tempest-TestStampPattern-888657205 None] Created volume successfully. Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Flow 'volume_create_manager' (579a1732-d07e-494c-8243-25d50d7fe328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90000b67-762d-4ac5-8a2f-ef9e01371f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90000b67-762d-4ac5-8a2f-ef9e01371f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2974463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e0cb24-3a99-4151-b2a2-6bd4e70008a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f36fd86fd894a219cc2ca0f0ba519b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:02Z,use_quota=True,user_id='03a9bf9f89df4be29cafc4540e62854a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6bc69f-f319-4213-a31c-3e8b5b9a3bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6bc69f-f319-4213-a31c-3e8b5b9a3bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9546ba28-1d6c-4284-bb95-f70145939b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9546ba28-1d6c-4284-bb95-f70145939b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73e0cb24-3a99-4151-b2a2-6bd4e70008a1', 'volume_name': 'volume-73e0cb24-3a99-4151-b2a2-6bd4e70008a1', 'volume_size': 2}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7305d21f-f542-40f6-b56f-50d42c1fca40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7305d21f-f542-40f6-b56f-50d42c1fca40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8f377f-5e52-41ae-bf5f-46670dd1e8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:02 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Volume 73e0cb24-3a99-4151-b2a2-6bd4e70008a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73e0cb24-3a99-4151-b2a2-6bd4e70008a1', 'volume_size': 2} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2974463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e0cb24-3a99-4151-b2a2-6bd4e70008a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f36fd86fd894a219cc2ca0f0ba519b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:02Z,use_quota=True,user_id='03a9bf9f89df4be29cafc4540e62854a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Creating volume 73e0cb24-3a99-4151-b2a2-6bd4e70008a1 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:11:02 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:11:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-73e0cb24-3a99-4151-b2a2-6bd4e70008a1 2147483648 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:02 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-73e0cb24-3a99-4151-b2a2-6bd4e70008a1 2147483648 Sep 17 15:11:02 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:03 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-73e0cb24-3a99-4151-b2a2-6bd4e70008a1 2147483648" returned: 0 in 0.777s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-73e0cb24-3a99-4151-b2a2-6bd4e70008a1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:03 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-73e0cb24-3a99-4151-b2a2-6bd4e70008a1 Sep 17 15:11:03 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:03 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-73e0cb24-3a99-4151-b2a2-6bd4e70008a1" returned: 0 in 0.357s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:11:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8f377f-5e52-41ae-bf5f-46670dd1e8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73e0cb24-3a99-4151-b2a2-6bd4e70008a1', 'volume_size': 2}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257144e6-06b2-4dca-bd88-e830f801b10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:03 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Volume volume-73e0cb24-3a99-4151-b2a2-6bd4e70008a1 (73e0cb24-3a99-4151-b2a2-6bd4e70008a1): created successfully Sep 17 15:11:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257144e6-06b2-4dca-bd88-e830f801b10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Flow 'volume_create_manager' (579a1732-d07e-494c-8243-25d50d7fe328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b7f47e87-a41f-4b2f-9378-3d858e721c62 tempest-VolumesCloneNegativeTest-1067599776 None] Created volume successfully. Sep 17 15:11:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] Acquiring lock "cinder-73e0cb24-3a99-4151-b2a2-6bd4e70008a1-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] Lock "cinder-73e0cb24-3a99-4151-b2a2-6bd4e70008a1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] Acquiring lock "cinder-quobyte-73e0cb24-3a99-4151-b2a2-6bd4e70008a1" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] Lock "cinder-quobyte-73e0cb24-3a99-4151-b2a2-6bd4e70008a1" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:04 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73c30b0-91df-41b8-85a8-a84f86a4108f]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-73e0cb24-3a99-4151-b2a2-6bd4e70008a1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:04 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-73e0cb24-3a99-4151-b2a2-6bd4e70008a1 Sep 17 15:11:05 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:05 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-73e0cb24-3a99-4151-b2a2-6bd4e70008a1" returned: 0 in 0.475s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-73e0cb24-3a99-4151-b2a2-6bd4e70008a1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:05 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-73e0cb24-3a99-4151-b2a2-6bd4e70008a1 Sep 17 15:11:05 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:05 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-73e0cb24-3a99-4151-b2a2-6bd4e70008a1" returned: 0 in 0.315s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] Lock "cinder-quobyte-73e0cb24-3a99-4151-b2a2-6bd4e70008a1" released by "delete_volume" :: held 0.846s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:05 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] Created reservations ['1f6cbdc5-1010-4d32-adaa-2de63b656d99', '8354339f-ecb9-4442-875b-4a80fd7ef396', 'fd787f77-6d0d-4ea0-b8b4-54e2c3568aa5', '1cc5880a-17cb-4e57-ab60-3a18b4d59388'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:05 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:11:05 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:06 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.360s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:06 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:06 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] Deleted volume successfully. Sep 17 15:11:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a90db194-d981-40f2-a546-21b87bdca8b9 tempest-VolumesCloneNegativeTest-1067599776 None] Lock "cinder-73e0cb24-3a99-4151-b2a2-6bd4e70008a1-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Flow 'volume_create_manager' (82a9a2bc-b9d1-4e3d-90ff-64788db6d1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e22bec1-ef4a-4c3e-9977-ba5f83f40b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e22bec1-ef4a-4c3e-9977-ba5f83f40b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1945570536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ffe1665-38b5-4a6b-9834-95b1e68427d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eaa7ed86e234e81a9d0e29e5b753b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:10Z,use_quota=True,user_id='b98efccf41c04bf8b69547b157805a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454bc057-5d55-49f4-bf45-7dfe40e44b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454bc057-5d55-49f4-bf45-7dfe40e44b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d785e61e-d3b2-4a88-8567-faf16815358c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d785e61e-d3b2-4a88-8567-faf16815358c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ffe1665-38b5-4a6b-9834-95b1e68427d0', 'volume_name': 'volume-7ffe1665-38b5-4a6b-9834-95b1e68427d0', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb9d8b3-6029-44e6-b065-022614632a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb9d8b3-6029-44e6-b065-022614632a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6250a3-4b7b-439b-9bed-61223498b3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:10 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Volume 7ffe1665-38b5-4a6b-9834-95b1e68427d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ffe1665-38b5-4a6b-9834-95b1e68427d0', 'volume_size': 1} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1945570536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ffe1665-38b5-4a6b-9834-95b1e68427d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eaa7ed86e234e81a9d0e29e5b753b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:10Z,use_quota=True,user_id='b98efccf41c04bf8b69547b157805a49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Creating volume 7ffe1665-38b5-4a6b-9834-95b1e68427d0 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:11:10 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7ffe1665-38b5-4a6b-9834-95b1e68427d0 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:10 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7ffe1665-38b5-4a6b-9834-95b1e68427d0 1073741824 Sep 17 15:11:10 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:10 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7ffe1665-38b5-4a6b-9834-95b1e68427d0 1073741824" returned: 0 in 0.466s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7ffe1665-38b5-4a6b-9834-95b1e68427d0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:10 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7ffe1665-38b5-4a6b-9834-95b1e68427d0 Sep 17 15:11:10 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:11 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7ffe1665-38b5-4a6b-9834-95b1e68427d0" returned: 0 in 0.276s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:11:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b6250a3-4b7b-439b-9bed-61223498b3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ffe1665-38b5-4a6b-9834-95b1e68427d0', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802b70a9-c5c6-4a2c-97de-a5a091e0e2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:11 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Volume volume-7ffe1665-38b5-4a6b-9834-95b1e68427d0 (7ffe1665-38b5-4a6b-9834-95b1e68427d0): created successfully Sep 17 15:11:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802b70a9-c5c6-4a2c-97de-a5a091e0e2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Flow 'volume_create_manager' (82a9a2bc-b9d1-4e3d-90ff-64788db6d1c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2c424f03-4dde-4ab5-a1e4-26700fd137d7 tempest-VolumesNegativeTest-995880817 None] Created volume successfully. Sep 17 15:11:21 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=23,cinder:INSERT=9,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:11:21 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:DELETE=4,cinder:SELECT=20,cinder:INSERT=6,cinder:UPDATE=38 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:11:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-fa84a10a-0429-4ccb-bd44-f5d2a0cee455 req-cc228a56-a18c-4e07-9533-57b1d889d7bc tempest-TestStampPattern-888657205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-fa84a10a-0429-4ccb-bd44-f5d2a0cee455 req-cc228a56-a18c-4e07-9533-57b1d889d7bc tempest-TestStampPattern-888657205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-fa84a10a-0429-4ccb-bd44-f5d2a0cee455 req-cc228a56-a18c-4e07-9533-57b1d889d7bc tempest-TestStampPattern-888657205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-fa84a10a-0429-4ccb-bd44-f5d2a0cee455 req-cc228a56-a18c-4e07-9533-57b1d889d7bc tempest-TestStampPattern-888657205 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-a974ac55-0464-4209-a8ae-03a2c95ccc67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26007723-8d3f-47eb-8a5d-23136fb737e3', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:11:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-fa84a10a-0429-4ccb-bd44-f5d2a0cee455 req-cc228a56-a18c-4e07-9533-57b1d889d7bc tempest-TestStampPattern-888657205 None] attachment_update completed successfully. Sep 17 15:11:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] Acquiring lock "cinder-7ffe1665-38b5-4a6b-9834-95b1e68427d0-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] Lock "cinder-7ffe1665-38b5-4a6b-9834-95b1e68427d0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] Acquiring lock "cinder-quobyte-7ffe1665-38b5-4a6b-9834-95b1e68427d0" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] Lock "cinder-quobyte-7ffe1665-38b5-4a6b-9834-95b1e68427d0" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:31 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b28a66-b929-470a-bb7f-0fce316d72aa]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7ffe1665-38b5-4a6b-9834-95b1e68427d0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:31 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7ffe1665-38b5-4a6b-9834-95b1e68427d0 Sep 17 15:11:31 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:31 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7ffe1665-38b5-4a6b-9834-95b1e68427d0" returned: 0 in 0.454s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7ffe1665-38b5-4a6b-9834-95b1e68427d0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:31 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7ffe1665-38b5-4a6b-9834-95b1e68427d0 Sep 17 15:11:31 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:31 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-c8ee911b-656a-4d77-903d-e6262c9de42a req-0677118d-3837-4a2d-8f22-67a79f0cc637 tempest-TestStampPattern-888657205 None] Terminate volume connection completed successfully. Sep 17 15:11:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-c8ee911b-656a-4d77-903d-e6262c9de42a req-0677118d-3837-4a2d-8f22-67a79f0cc637 tempest-TestStampPattern-888657205 None] Deleting attachment 26007723-8d3f-47eb-8a5d-23136fb737e3. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:11:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7ffe1665-38b5-4a6b-9834-95b1e68427d0" returned: 0 in 0.297s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] Lock "cinder-quobyte-7ffe1665-38b5-4a6b-9834-95b1e68427d0" released by "delete_volume" :: held 0.820s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:31 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] Created reservations ['e0b65878-ac9e-4393-a194-4c4828bf9f63', 'b94cf7b3-28b7-4526-8ff8-e7e435d2789e', '22a01038-85d1-4b89-ad0f-e55849c7a678', '6d0d8855-39d5-4565-9bdd-4e646849f543'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:32 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:11:32 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:32 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.292s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:32 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:32 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] Deleted volume successfully. Sep 17 15:11:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-15d922a7-2701-4813-9c38-72b647ea2cac tempest-VolumesNegativeTest-995880817 None] Lock "cinder-7ffe1665-38b5-4a6b-9834-95b1e68427d0-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:34 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:11:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Flow 'volume_create_manager' (62279c09-fa9b-44a9-a376-ba1b59e9641b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206b9e9e-2b29-4f04-bf81-561a4bf6107c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206b9e9e-2b29-4f04-bf81-561a4bf6107c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1896814095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae1d3fa-6b7f-4f50-917a-f1753809be78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e581e4f2c0614acd85989a8082084d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:34Z,use_quota=True,user_id='2582f7ac62184bb09a77b01305f1322d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526ba55f-902d-417e-882f-101010ed9cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526ba55f-902d-417e-882f-101010ed9cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865caf68-3614-499b-b9b8-2d81dc85c142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:34 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:11:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865caf68-3614-499b-b9b8-2d81dc85c142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bae1d3fa-6b7f-4f50-917a-f1753809be78', 'volume_name': 'volume-bae1d3fa-6b7f-4f50-917a-f1753809be78', 'volume_size': 1, 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a89aff0fcdbc4ac4a1aadbcc303a1058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd928b357-d516-479a-9030-78a0e857cb53', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d928b357-d516-479a-9030-78a0e857cb53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad8400a-51cd-4805-abf5-7985100fa3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad8400a-51cd-4805-abf5-7985100fa3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df0ed25-cded-4a60-b4f1-a5348982df6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:35 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Volume bae1d3fa-6b7f-4f50-917a-f1753809be78: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bae1d3fa-6b7f-4f50-917a-f1753809be78', 'volume_size': 1, 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a89aff0fcdbc4ac4a1aadbcc303a1058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd928b357-d516-479a-9030-78a0e857cb53', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d928b357-d516-479a-9030-78a0e857cb53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 15:11:35 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Trying to clone bae1d3fa-6b7f-4f50-917a-f1753809be78 from image d928b357-d516-479a-9030-78a0e857cb53 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:11:35 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_qmtpzd9qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 15:11:35 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Image download 20.69 MB at 20.69 MB/s Sep 17 15:11:35 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba982d0-9140-4555-aec2-c7c2727a8765]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_qmtpzd9qdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:36 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_qmtpzd9qdevstack@QuobyteHD Sep 17 15:11:36 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:36 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_qmtpzd9qdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Temporary image d928b357-d516-479a-9030-78a0e857cb53 is fetched for user 2582f7ac62184bb09a77b01305f1322d. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c39e29-781e-4c7c-8861-b9d6d62e2947]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_qmtpzd9qdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:36 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_qmtpzd9qdevstack@QuobyteHD Sep 17 15:11:36 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:36 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_qmtpzd9qdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1896814095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae1d3fa-6b7f-4f50-917a-f1753809be78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e581e4f2c0614acd85989a8082084d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:34Z,use_quota=True,user_id='2582f7ac62184bb09a77b01305f1322d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Creating volume bae1d3fa-6b7f-4f50-917a-f1753809be78 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:11:36 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:36 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78 1073741824 Sep 17 15:11:36 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Flow 'volume_create_manager' (8eadd3e3-4cce-4d04-a396-b2f903f5d19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153fe523-26a2-41f9-8303-1b50f0d36b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153fe523-26a2-41f9-8303-1b50f0d36b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1370836598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b072a8-d99f-41fb-b73f-0e67b0553dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c03b3fb2c75444e8c37cd361edd91b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:37Z,use_quota=True,user_id='27a9ee9d919d4464a93579b8568657d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941f9a4b-c72b-4e78-8651-71fb33e2350e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941f9a4b-c72b-4e78-8651-71fb33e2350e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (365a73cb-aeb0-40f8-85ac-267bc803ded2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (365a73cb-aeb0-40f8-85ac-267bc803ded2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b072a8-d99f-41fb-b73f-0e67b0553dd0', 'volume_name': 'volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0', 'volume_size': 2}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e899d6-ac6d-4a25-9aa8-aa03ca839dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e899d6-ac6d-4a25-9aa8-aa03ca839dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0edb09ba-c49d-49cd-a139-2f5ef750beb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:37 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Volume 20b072a8-d99f-41fb-b73f-0e67b0553dd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0', 'volume_size': 2} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] Acquiring lock "cinder-a974ac55-0464-4209-a8ae-03a2c95ccc67-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] Lock "cinder-a974ac55-0464-4209-a8ae-03a2c95ccc67-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] Acquiring lock "cinder-quobyte-a974ac55-0464-4209-a8ae-03a2c95ccc67" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] Lock "cinder-quobyte-a974ac55-0464-4209-a8ae-03a2c95ccc67" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[58544659-8179-4135-9814-4877b8ab87d9]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a974ac55-0464-4209-a8ae-03a2c95ccc67 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:37 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78 1073741824" returned: 0 in 0.483s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:37 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a974ac55-0464-4209-a8ae-03a2c95ccc67 Sep 17 15:11:37 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:37 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78 Sep 17 15:11:37 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:37 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78" returned: 0 in 0.293s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.502s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1370836598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b072a8-d99f-41fb-b73f-0e67b0553dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c03b3fb2c75444e8c37cd361edd91b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:37Z,use_quota=True,user_id='27a9ee9d919d4464a93579b8568657d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Creating volume 20b072a8-d99f-41fb-b73f-0e67b0553dd0 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:11:37 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:11:37 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0 2147483648 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a974ac55-0464-4209-a8ae-03a2c95ccc67" returned: 0 in 0.420s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a974ac55-0464-4209-a8ae-03a2c95ccc67 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:37 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0 2147483648 Sep 17 15:11:37 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:37 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a974ac55-0464-4209-a8ae-03a2c95ccc67 Sep 17 15:11:37 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Attempting download of d928b357-d516-479a-9030-78a0e857cb53 ((None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}])) to volume bae1d3fa-6b7f-4f50-917a-f1753809be78. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c0e05a-ced9-4659-9ecd-47a5b978111d]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_98_x57sl {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:37 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_98_x57sl Sep 17 15:11:37 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:37 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a974ac55-0464-4209-a8ae-03a2c95ccc67" returned: 0 in 0.285s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] Lock "cinder-quobyte-a974ac55-0464-4209-a8ae-03a2c95ccc67" released by "delete_volume" :: held 0.752s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] Created reservations ['77b1733d-983b-4d6b-a7f5-1408b2877447', '2ea7fcb0-17b8-423c-8db9-4bf1fa816382', 'c2823907-b0b3-46f2-889d-81fd8e8e73c4', '478bbc40-5595-4475-b97c-6e2ff602e628'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:38 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_98_x57sl" returned: 0 in 0.355s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_98_x57sl {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:38 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:11:38 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:38 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0 2147483648" returned: 0 in 0.592s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:38 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_98_x57sl Sep 17 15:11:38 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:38 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0 Sep 17 15:11:38 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:38 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.322s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:38 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] Deleted volume successfully. Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9f4794cb-61f2-45aa-a4fa-d40eab3d5199 tempest-TestStampPattern-888657205 None] Lock "cinder-a974ac55-0464-4209-a8ae-03a2c95ccc67-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:38 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_98_x57sl" returned: 1 in 0.371s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d928b357-d516-479a-9030-78a0e857cb53_98_x57sl' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9b96f8-f578-4618-82ad-39028ac01e72]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_qmtpzd9qdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:38 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0" returned: 0 in 0.338s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:38 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_qmtpzd9qdevstack@QuobyteHD Sep 17 15:11:38 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] Acquiring lock "cinder-8edd964d-7572-4d02-a52b-17fb2f0ee67e-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0edb09ba-c49d-49cd-a139-2f5ef750beb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0', 'volume_size': 2}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81637b76-e85f-4a81-befa-70ffc94bb216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] Lock "cinder-8edd964d-7572-4d02-a52b-17fb2f0ee67e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] Acquiring lock "cinder-quobyte-fa26e41e-4f12-445c-bd1b-de4d12d32e58" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:38 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Volume volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0 (20b072a8-d99f-41fb-b73f-0e67b0553dd0): created successfully Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81637b76-e85f-4a81-befa-70ffc94bb216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Flow 'volume_create_manager' (8eadd3e3-4cce-4d04-a396-b2f903f5d19c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] Lock "cinder-quobyte-fa26e41e-4f12-445c-bd1b-de4d12d32e58" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] Acquiring lock "cinder-quobyte-8edd964d-7572-4d02-a52b-17fb2f0ee67e" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:38 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-104f196e-4bc6-49f6-8151-62926798e461 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Created volume successfully. Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] Lock "cinder-quobyte-8edd964d-7572-4d02-a52b-17fb2f0ee67e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] Deleting offline snapshot 8edd964d-7572-4d02-a52b-17fb2f0ee67e of volume fa26e41e-4f12-445c-bd1b-de4d12d32e58 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] snapshot_file for this snap is: volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9fdbd8-80d6-48a5-aed3-ca81f1310adb]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:38 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_qmtpzd9qdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] d928b357-d516-479a-9030-78a0e857cb53 was qcow2, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 15:11:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_qmtpzd9qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:38 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_qmtpzd9qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78 Sep 17 15:11:38 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:38 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e Sep 17 15:11:38 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:39 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e" returned: 0 in 0.394s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:11:39 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[936efe90-cbf7-4bf4-9593-9e994089c48c]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Creating offline snapshot a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd of volume 20b072a8-d99f-41fb-b73f-0e67b0553dd0 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:11:39 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 Sep 17 15:11:39 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:39 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b694104d-5819-4695-bee1-eeac839e44cc]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:39 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0 Sep 17 15:11:39 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:39 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0" returned: 0 in 0.475s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd 2G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:39 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd 2G Sep 17 15:11:39 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:39 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58" returned: 0 in 0.679s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:39 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e Sep 17 15:11:39 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:40 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e" returned: 0 in 0.384s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:40 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e Sep 17 15:11:40 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:40 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd 2G" returned: 0 in 0.507s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:40 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd Sep 17 15:11:40 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:40 devstack sudo[102840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:11:40 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:40 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58.8edd964d-7572-4d02-a52b-17fb2f0ee67e" returned: 0 in 0.284s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] Lock "cinder-quobyte-8edd964d-7572-4d02-a52b-17fb2f0ee67e" released by "_delete_snapshot" :: held 1.876s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] Lock "cinder-quobyte-fa26e41e-4f12-445c-bd1b-de4d12d32e58" released by "delete_snapshot" :: held 1.912s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] Created reservations ['a1758e16-09bc-4737-8479-e525c38c54f8', '34aa20b8-2208-4028-861b-3d0ec90f4fc8', '8645319b-ebe0-4f09-bbd2-f41b6ee1a07a', '6280ca40-41ff-43e4-b6aa-32929c36bf84'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd" returned: 0 in 0.392s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:40 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd is being set with open permissions: ugo+rw Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:40 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] Delete snapshot completed successfully. Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-07b5be3f-c241-4d9e-85ec-be47060af138 tempest-TestStampPattern-888657205 None] Lock "cinder-8edd964d-7572-4d02-a52b-17fb2f0ee67e-delete_snapshot" released by "delete_snapshot" :: held 2.181s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:40 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:40 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd Sep 17 15:11:40 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:40 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.410s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:11:40 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_qmtpzd9qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78" returned: 0 in 2.198s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d928b357-d516-479a-9030-78a0e857cb53_qmtpzd9qdevstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:11:40 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Converted 112.00 MB image at 50.93 MB/s Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:40 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78 1G Sep 17 15:11:40 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:40 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd" returned: 0 in 0.345s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:41 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.info Sep 17 15:11:41 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:41 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.info" returned: 0 in 0.306s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:41 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.info is being set with open permissions: ugo+rw Sep 17 15:11:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:41 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78 1G" returned: 0 in 0.402s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:41 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Downloaded image d928b357-d516-479a-9030-78a0e857cb53 ((None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}])) to volume bae1d3fa-6b7f-4f50-917a-f1753809be78 successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:11:41 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.info Sep 17 15:11:41 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:41 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Temporary image d928b357-d516-479a-9030-78a0e857cb53 for user 2582f7ac62184bb09a77b01305f1322d is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 15:11:41 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Marking volume bae1d3fa-6b7f-4f50-917a-f1753809be78 as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:11:41 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Copying metadata from image d928b357-d516-479a-9030-78a0e857cb53 to bae1d3fa-6b7f-4f50-917a-f1753809be78. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:11:41 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Creating volume glance metadata for volume bae1d3fa-6b7f-4f50-917a-f1753809be78 backed by image d928b357-d516-479a-9030-78a0e857cb53 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:11:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df0ed25-cded-4a60-b4f1-a5348982df6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae1d3fa-6b7f-4f50-917a-f1753809be78', 'volume_size': 1, 'image_id': 'd928b357-d516-479a-9030-78a0e857cb53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d928b357-d516-479a-9030-78a0e857cb53', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a89aff0fcdbc4ac4a1aadbcc303a1058', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd928b357-d516-479a-9030-78a0e857cb53', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d928b357-d516-479a-9030-78a0e857cb53/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00bd6a77-e7ed-410b-b819-f3f605650dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:41 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Volume volume-bae1d3fa-6b7f-4f50-917a-f1753809be78 (bae1d3fa-6b7f-4f50-917a-f1753809be78): created successfully Sep 17 15:11:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00bd6a77-e7ed-410b-b819-f3f605650dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Flow 'volume_create_manager' (62279c09-fa9b-44a9-a376-ba1b59e9641b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-470205ee-d8f4-4648-8c9a-61bb32f4d3c9 tempest-TestShelveInstance-61082965 None] Created volume successfully. Sep 17 15:11:41 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.info" returned: 0 in 0.318s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.449s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7a7bc98b-6d09-4867-b1d8-c5b7102ffa7a tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Create snapshot completed successfully Sep 17 15:11:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Acquiring lock "cinder-a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Lock "cinder-a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Acquiring lock "cinder-quobyte-20b072a8-d99f-41fb-b73f-0e67b0553dd0" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Lock "cinder-quobyte-20b072a8-d99f-41fb-b73f-0e67b0553dd0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Acquiring lock "cinder-quobyte-a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Lock "cinder-quobyte-a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Deleting offline snapshot a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd of volume 20b072a8-d99f-41fb-b73f-0e67b0553dd0 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:11:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] snapshot_file for this snap is: volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:11:42 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d368afb-cfee-4a19-93fd-4347261d8692]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:42 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd Sep 17 15:11:42 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:43 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd" returned: 0 in 0.507s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:11:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f427b281-234e-4ec2-8ce5-734271e492e8]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:43 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0 Sep 17 15:11:43 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:43 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0" returned: 0 in 0.469s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:43 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd Sep 17 15:11:43 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:44 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd" returned: 0 in 0.408s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:44 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd Sep 17 15:11:44 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:44 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0.a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd" returned: 0 in 0.284s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Lock "cinder-quobyte-a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd" released by "_delete_snapshot" :: held 1.827s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Lock "cinder-quobyte-20b072a8-d99f-41fb-b73f-0e67b0553dd0" released by "delete_snapshot" :: held 1.861s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] Acquiring lock "cinder-fa26e41e-4f12-445c-bd1b-de4d12d32e58-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] Lock "cinder-fa26e41e-4f12-445c-bd1b-de4d12d32e58-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:44 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Created reservations ['72bc1630-64fe-4c20-991c-9e9a68bd61c5', 'f3e1ef59-acdc-4b22-a54e-b3a2fb1b07ca', '411251af-8454-4bac-9308-11d22ecd3b03', '0ac24f87-30e3-48de-91e5-b9a8419a2e1f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] Acquiring lock "cinder-quobyte-fa26e41e-4f12-445c-bd1b-de4d12d32e58" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] Lock "cinder-quobyte-fa26e41e-4f12-445c-bd1b-de4d12d32e58" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Delete snapshot completed successfully. Sep 17 15:11:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6646bbac-7fb5-4a32-9704-1b04c78d5be3 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Lock "cinder-a8af18d7-b7e4-431b-adc2-5e02b6cc8fbd-delete_snapshot" released by "delete_snapshot" :: held 2.117s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:44 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[01222b89-905d-4dd5-bf8f-ea82eda26c4c]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:44 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 Sep 17 15:11:44 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Acquiring lock "cinder-20b072a8-d99f-41fb-b73f-0e67b0553dd0-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Lock "cinder-20b072a8-d99f-41fb-b73f-0e67b0553dd0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Acquiring lock "cinder-quobyte-20b072a8-d99f-41fb-b73f-0e67b0553dd0" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Lock "cinder-quobyte-20b072a8-d99f-41fb-b73f-0e67b0553dd0" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[08431d7f-7b63-476b-b1e7-ee4bee449498]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:45 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0 Sep 17 15:11:45 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:45 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58" returned: 0 in 0.523s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:45 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58 Sep 17 15:11:45 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:45 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0" returned: 0 in 0.478s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:45 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0 Sep 17 15:11:45 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:45 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa26e41e-4f12-445c-bd1b-de4d12d32e58" returned: 0 in 0.331s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] Lock "cinder-quobyte-fa26e41e-4f12-445c-bd1b-de4d12d32e58" released by "delete_volume" :: held 0.951s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] Created reservations ['4325b0d7-a364-4ce5-a9d3-f9aa3bc21071', '8f7949c2-2dc1-4935-b5c5-6eb1ed84bdd8', 'd8b177cb-3c3a-4789-bbef-c8724975c460', 'd07aaff8-27a5-46dd-aae1-01ad4958adc3'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-bdd45071-98d6-438d-b511-13759ca7bdf2 req-ad826886-0030-4387-b9ba-939dbc93ec4a tempest-TestShelveInstance-61082965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-bdd45071-98d6-438d-b511-13759ca7bdf2 req-ad826886-0030-4387-b9ba-939dbc93ec4a tempest-TestShelveInstance-61082965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-bdd45071-98d6-438d-b511-13759ca7bdf2 req-ad826886-0030-4387-b9ba-939dbc93ec4a tempest-TestShelveInstance-61082965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-bdd45071-98d6-438d-b511-13759ca7bdf2 req-ad826886-0030-4387-b9ba-939dbc93ec4a tempest-TestShelveInstance-61082965 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-bae1d3fa-6b7f-4f50-917a-f1753809be78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4e79d03-ee17-4a5f-be51-c2131de51b1c', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:45 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-20b072a8-d99f-41fb-b73f-0e67b0553dd0" returned: 0 in 0.313s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:45 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:11:45 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Lock "cinder-quobyte-20b072a8-d99f-41fb-b73f-0e67b0553dd0" released by "delete_volume" :: held 0.881s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-bdd45071-98d6-438d-b511-13759ca7bdf2 req-ad826886-0030-4387-b9ba-939dbc93ec4a tempest-TestShelveInstance-61082965 None] attachment_update completed successfully. Sep 17 15:11:45 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Created reservations ['63491ec0-a502-4325-bc7c-3837f4415b34', '2a9ed0c8-b679-4f35-b96d-15a530fb82c6', 'cc4e85e2-5f80-44e8-ad8a-c70b1e392c32', '2917495b-e50f-4a83-a084-db82aaadfd3b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:46 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:11:46 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:46 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.449s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:46 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] Deleted volume successfully. Sep 17 15:11:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56d75021-c30e-4423-812c-7e9b568f5a8f tempest-TestStampPattern-888657205 None] Lock "cinder-fa26e41e-4f12-445c-bd1b-de4d12d32e58-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:46 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.413s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:46 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Deleted volume successfully. Sep 17 15:11:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3d2ef872-d19f-485d-9347-f3f66f961259 tempest-VolumesSnapshotNegativeTestJSON-439347970 None] Lock "cinder-20b072a8-d99f-41fb-b73f-0e67b0553dd0-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:56 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=58,cinder:UPDATE=58,cinder:INSERT=18,cinder:DELETE=2 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:11:56 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=63,cinder:UPDATE=53,cinder:INSERT=22,cinder:DELETE=5 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:12:12 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:12:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Flow 'volume_create_manager' (7a8d487a-b3f3-4259-a164-a3a519b61f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f83ee4d-c6ee-4c49-97af-77246926260d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f83ee4d-c6ee-4c49-97af-77246926260d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13060b0f-ca8b-42af-97d5-2a947cedc5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7348bbb4ffd44d35a198bf69d8eef267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:12Z,use_quota=True,user_id='497de063b3b94cbe8d963551d46fe578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f85e977-17bf-4775-9843-8bd007ba72c5),volume_type_id=0f85e977-17bf-4775-9843-8bd007ba72c5)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0f3950-e089-4b1d-ac0b-187aa75274e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b0f3950-e089-4b1d-ac0b-187aa75274e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e2a5fb-82f2-47e0-9c6a-8f319fecb630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:12 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:12:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e2a5fb-82f2-47e0-9c6a-8f319fecb630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '13060b0f-ca8b-42af-97d5-2a947cedc5e9', 'volume_name': 'volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9', 'volume_size': 1, 'image_id': '24d7e5b3-c1c8-4111-9edc-2cae16689065', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24d7e5b3-c1c8-4111-9edc-2cae16689065', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a8afd96e0153069a04a47159d0f1881b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7348bbb4ffd44d35a198bf69d8eef267', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6149244c9ba8de7de8f89aeb475e2d3cd8868c384cc4fb41b893aae7f6359314099401e799e0d2fe6d5f0b54ee557299c9c4054b1f70e843cd1562155b99657f', 'id': '24d7e5b3-c1c8-4111-9edc-2cae16689065', 'created_at': datetime.datetime(2026, 9, 17, 13, 12, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 12, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24d7e5b3-c1c8-4111-9edc-2cae16689065/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30bb2a44-6017-46b0-bc2f-b96aaf618f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30bb2a44-6017-46b0-bc2f-b96aaf618f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4554e3-8b4c-43b8-9384-2017c466937a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:12 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Volume 13060b0f-ca8b-42af-97d5-2a947cedc5e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9', 'volume_size': 1, 'image_id': '24d7e5b3-c1c8-4111-9edc-2cae16689065', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24d7e5b3-c1c8-4111-9edc-2cae16689065', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a8afd96e0153069a04a47159d0f1881b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7348bbb4ffd44d35a198bf69d8eef267', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6149244c9ba8de7de8f89aeb475e2d3cd8868c384cc4fb41b893aae7f6359314099401e799e0d2fe6d5f0b54ee557299c9c4054b1f70e843cd1562155b99657f', 'id': '24d7e5b3-c1c8-4111-9edc-2cae16689065', 'created_at': datetime.datetime(2026, 9, 17, 13, 12, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 12, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24d7e5b3-c1c8-4111-9edc-2cae16689065/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 17 15:12:12 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Trying to clone 13060b0f-ca8b-42af-97d5-2a947cedc5e9 from image 24d7e5b3-c1c8-4111-9edc-2cae16689065 at location (None, [{'url': 'file:///opt/stack/data/glance/images/24d7e5b3-c1c8-4111-9edc-2cae16689065', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:12:12 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 15:12:12 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Image download 0.00 MB at 0.00 MB/s Sep 17 15:12:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4a701f-e5bd-4565-b1d4-b7c9a6181668]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:12 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD Sep 17 15:12:12 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:12 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:12 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD Sep 17 15:12:12 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:13 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:12:13 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Temporary image 24d7e5b3-c1c8-4111-9edc-2cae16689065 is fetched for user 497de063b3b94cbe8d963551d46fe578. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 15:12:13 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e54d6ba-d5d6-4381-92d8-f2364a037a84]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:13 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD Sep 17 15:12:13 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:13 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:13 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD Sep 17 15:12:13 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:14 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13060b0f-ca8b-42af-97d5-2a947cedc5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7348bbb4ffd44d35a198bf69d8eef267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:12Z,use_quota=True,user_id='497de063b3b94cbe8d963551d46fe578',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f85e977-17bf-4775-9843-8bd007ba72c5),volume_type_id=0f85e977-17bf-4775-9843-8bd007ba72c5)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Creating volume 13060b0f-ca8b-42af-97d5-2a947cedc5e9 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:12:14 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:14 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9 1073741824 Sep 17 15:12:14 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:14 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9 1073741824" returned: 0 in 0.461s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:14 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9 Sep 17 15:12:14 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:14 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9" returned: 0 in 0.264s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Attempting download of 24d7e5b3-c1c8-4111-9edc-2cae16689065 ((None, [{'url': 'file:///opt/stack/data/glance/images/24d7e5b3-c1c8-4111-9edc-2cae16689065', 'metadata': {}}])) to volume 13060b0f-ca8b-42af-97d5-2a947cedc5e9. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6a00cd-6e07-4982-be08-1f722f4a25f8]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24d7e5b3-c1c8-4111-9edc-2cae16689065_9w24x09d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:15 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24d7e5b3-c1c8-4111-9edc-2cae16689065_9w24x09d Sep 17 15:12:15 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:15 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24d7e5b3-c1c8-4111-9edc-2cae16689065_9w24x09d" returned: 0 in 0.357s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24d7e5b3-c1c8-4111-9edc-2cae16689065_9w24x09d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:15 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24d7e5b3-c1c8-4111-9edc-2cae16689065_9w24x09d Sep 17 15:12:15 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:15 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24d7e5b3-c1c8-4111-9edc-2cae16689065_9w24x09d" returned: 1 in 0.333s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24d7e5b3-c1c8-4111-9edc-2cae16689065_9w24x09d' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:12:15 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f1329e-d33c-427a-9b79-9f2b782bdc4b]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:15 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD Sep 17 15:12:15 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:16 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:16 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD Sep 17 15:12:16 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:16 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:12:16 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] 24d7e5b3-c1c8-4111-9edc-2cae16689065 was raw, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 15:12:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:16 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9 Sep 17 15:12:16 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:16 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9" returned: 0 in 0.599s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:16 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24d7e5b3-c1c8-4111-9edc-2cae16689065_m4svyxjkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:12:16 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 15:12:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:17 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9 1G Sep 17 15:12:17 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:17 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9 1G" returned: 0 in 0.473s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:17 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Downloaded image 24d7e5b3-c1c8-4111-9edc-2cae16689065 ((None, [{'url': 'file:///opt/stack/data/glance/images/24d7e5b3-c1c8-4111-9edc-2cae16689065', 'metadata': {}}])) to volume 13060b0f-ca8b-42af-97d5-2a947cedc5e9 successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:12:17 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Temporary image 24d7e5b3-c1c8-4111-9edc-2cae16689065 for user 497de063b3b94cbe8d963551d46fe578 is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 15:12:17 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Marking volume 13060b0f-ca8b-42af-97d5-2a947cedc5e9 as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:12:17 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Copying metadata from image 24d7e5b3-c1c8-4111-9edc-2cae16689065 to 13060b0f-ca8b-42af-97d5-2a947cedc5e9. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:12:17 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Creating volume glance metadata for volume 13060b0f-ca8b-42af-97d5-2a947cedc5e9 backed by image 24d7e5b3-c1c8-4111-9edc-2cae16689065 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '24d7e5b3-c1c8-4111-9edc-2cae16689065', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a8afd96e0153069a04a47159d0f1881b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:12:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d4554e3-8b4c-43b8-9384-2017c466937a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9', 'volume_size': 1, 'image_id': '24d7e5b3-c1c8-4111-9edc-2cae16689065', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24d7e5b3-c1c8-4111-9edc-2cae16689065', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a8afd96e0153069a04a47159d0f1881b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7348bbb4ffd44d35a198bf69d8eef267', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6149244c9ba8de7de8f89aeb475e2d3cd8868c384cc4fb41b893aae7f6359314099401e799e0d2fe6d5f0b54ee557299c9c4054b1f70e843cd1562155b99657f', 'id': '24d7e5b3-c1c8-4111-9edc-2cae16689065', 'created_at': datetime.datetime(2026, 9, 17, 13, 12, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 12, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24d7e5b3-c1c8-4111-9edc-2cae16689065/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac9cbb4-090c-4e38-9aee-a121837ea457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:17 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Volume volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9 (13060b0f-ca8b-42af-97d5-2a947cedc5e9): created successfully Sep 17 15:12:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac9cbb4-090c-4e38-9aee-a121837ea457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Flow 'volume_create_manager' (7a8d487a-b3f3-4259-a164-a3a519b61f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:17 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-11d2053e-4eb2-4294-964d-5b944ca79112 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Created volume successfully. Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Flow 'volume_create_manager' (849be8ea-cddf-45bd-92f7-9f7a066cbbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64db0155-12d6-4b1c-94d5-ff00118920ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64db0155-12d6-4b1c-94d5-ff00118920ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-142084506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57843b1-ea82-48a3-b8bf-428a7803490c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e3f271a689a40a98edb8e0293c70a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:18Z,use_quota=True,user_id='5f94742bbc4d458c8aa37d7c42234270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785629d7-0562-4cb4-a7b5-51500380f44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785629d7-0562-4cb4-a7b5-51500380f44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394fbc23-f7b4-4815-a62e-f662e46e4dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (394fbc23-f7b4-4815-a62e-f662e46e4dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd57843b1-ea82-48a3-b8bf-428a7803490c', 'volume_name': 'volume-d57843b1-ea82-48a3-b8bf-428a7803490c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda91ee3-998e-4505-b4d2-2776a002e6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cda91ee3-998e-4505-b4d2-2776a002e6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d4aba3-d893-4b35-b68b-cd9d6ee6c97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:18 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Volume d57843b1-ea82-48a3-b8bf-428a7803490c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d57843b1-ea82-48a3-b8bf-428a7803490c', 'volume_size': 1} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-142084506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57843b1-ea82-48a3-b8bf-428a7803490c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e3f271a689a40a98edb8e0293c70a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:18Z,use_quota=True,user_id='5f94742bbc4d458c8aa37d7c42234270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Creating volume d57843b1-ea82-48a3-b8bf-428a7803490c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:12:18 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d57843b1-ea82-48a3-b8bf-428a7803490c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:18 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d57843b1-ea82-48a3-b8bf-428a7803490c 1073741824 Sep 17 15:12:18 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Acquiring lock "cinder-13060b0f-ca8b-42af-97d5-2a947cedc5e9-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Lock "cinder-13060b0f-ca8b-42af-97d5-2a947cedc5e9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Acquiring lock "cinder-quobyte-13060b0f-ca8b-42af-97d5-2a947cedc5e9" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Lock "cinder-quobyte-13060b0f-ca8b-42af-97d5-2a947cedc5e9" acquired by "delete_volume" :: waited 0.053s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Flow 'volume_create_manager' (dabfdfbf-d99c-4d50-babf-796487000e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e40fc52-0764-4da6-b443-3c152cae7841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b81e36-1c6b-49fc-8590-a1359199bdfd]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e40fc52-0764-4da6-b443-3c152cae7841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1606966065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82dc8306-5b0b-4481-8523-cdcc4c8883b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e3f271a689a40a98edb8e0293c70a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:19Z,use_quota=True,user_id='5f94742bbc4d458c8aa37d7c42234270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403d9321-7ee2-4ef3-b679-d9b649759154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403d9321-7ee2-4ef3-b679-d9b649759154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694d9b3b-c006-45a0-a7f5-bfadfc11ecf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694d9b3b-c006-45a0-a7f5-bfadfc11ecf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82dc8306-5b0b-4481-8523-cdcc4c8883b4', 'volume_name': 'volume-82dc8306-5b0b-4481-8523-cdcc4c8883b4', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfe3e58-ede7-476d-b3c6-b5eb93854aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfe3e58-ede7-476d-b3c6-b5eb93854aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cbe373-1899-437a-af14-225a8de09f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:18 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Volume 82dc8306-5b0b-4481-8523-cdcc4c8883b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82dc8306-5b0b-4481-8523-cdcc4c8883b4', 'volume_size': 1} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:18 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9 Sep 17 15:12:18 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:18 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d57843b1-ea82-48a3-b8bf-428a7803490c 1073741824" returned: 0 in 0.747s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d57843b1-ea82-48a3-b8bf-428a7803490c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:18 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d57843b1-ea82-48a3-b8bf-428a7803490c Sep 17 15:12:18 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:19 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9" returned: 0 in 0.532s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:19 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9 Sep 17 15:12:19 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:19 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d57843b1-ea82-48a3-b8bf-428a7803490c" returned: 0 in 0.380s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.557s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1606966065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82dc8306-5b0b-4481-8523-cdcc4c8883b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e3f271a689a40a98edb8e0293c70a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:19Z,use_quota=True,user_id='5f94742bbc4d458c8aa37d7c42234270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Creating volume 82dc8306-5b0b-4481-8523-cdcc4c8883b4 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:12:19 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-82dc8306-5b0b-4481-8523-cdcc4c8883b4 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17d4aba3-d893-4b35-b68b-cd9d6ee6c97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d57843b1-ea82-48a3-b8bf-428a7803490c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8252c76d-0af5-4d8a-92b5-5e63bdf4ddee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:19 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-82dc8306-5b0b-4481-8523-cdcc4c8883b4 1073741824 Sep 17 15:12:19 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:19 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Volume volume-d57843b1-ea82-48a3-b8bf-428a7803490c (d57843b1-ea82-48a3-b8bf-428a7803490c): created successfully Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8252c76d-0af5-4d8a-92b5-5e63bdf4ddee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Flow 'volume_create_manager' (849be8ea-cddf-45bd-92f7-9f7a066cbbdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:19 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2df7d770-650a-4e85-b0ab-1381fcab40c3 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Created volume successfully. Sep 17 15:12:19 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-13060b0f-ca8b-42af-97d5-2a947cedc5e9" returned: 0 in 0.359s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Lock "cinder-quobyte-13060b0f-ca8b-42af-97d5-2a947cedc5e9" released by "delete_volume" :: held 0.999s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:19 devstack cinder-volume[86082]: WARNING cinder.quota [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:12:19 devstack cinder-volume[86082]: WARNING cinder.quota [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Created reservations ['919d9fc0-d6c0-450a-98e3-0ed67034258e', 'd7463c84-1b96-4f6b-a220-8aba46bb927b', '938035e3-0bbe-4bc2-9199-34d602cbf9f0', '3228a4c2-0c95-4b7b-a27b-1f7e10284166'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:19 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:12:19 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:19 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-82dc8306-5b0b-4481-8523-cdcc4c8883b4 1073741824" returned: 0 in 0.625s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-82dc8306-5b0b-4481-8523-cdcc4c8883b4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:20 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.278s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:20 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:20 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Deleted volume successfully. Sep 17 15:12:20 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-82dc8306-5b0b-4481-8523-cdcc4c8883b4 Sep 17 15:12:20 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5bc8836e-8db4-461d-a833-64f919574d47 tempest-VolumeAndVolumeTypeFromImageTest-2130791852 None] Lock "cinder-13060b0f-ca8b-42af-97d5-2a947cedc5e9-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:20 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-82dc8306-5b0b-4481-8523-cdcc4c8883b4" returned: 0 in 0.326s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:12:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cbe373-1899-437a-af14-225a8de09f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82dc8306-5b0b-4481-8523-cdcc4c8883b4', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9784d432-53bf-4614-9a09-1d5f4a67a64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:20 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Volume volume-82dc8306-5b0b-4481-8523-cdcc4c8883b4 (82dc8306-5b0b-4481-8523-cdcc4c8883b4): created successfully Sep 17 15:12:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9784d432-53bf-4614-9a09-1d5f4a67a64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Flow 'volume_create_manager' (dabfdfbf-d99c-4d50-babf-796487000e3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:20 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7f239232-6db0-48ce-bdba-a146c495599b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Created volume successfully. Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Flow 'volume_create_manager' (c9e3601c-cfa7-493b-b9bd-26c7d493c4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37efce34-5644-4a13-8984-077a2c4421c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37efce34-5644-4a13-8984-077a2c4421c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-180735928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a81fc95-7bb2-4372-bab3-2b5891035858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f0ba613c4b142f2935e86e828d46632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:26Z,use_quota=True,user_id='ae4e1facc6e14df4a19b174308de2df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f15d54-8401-431d-9620-9f43f8252551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f15d54-8401-431d-9620-9f43f8252551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043ea08c-d760-41ae-9654-9c55420734e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (043ea08c-d760-41ae-9654-9c55420734e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a81fc95-7bb2-4372-bab3-2b5891035858', 'volume_name': 'volume-3a81fc95-7bb2-4372-bab3-2b5891035858', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f168f0-5d9b-44b4-9445-67fbcb8198f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f168f0-5d9b-44b4-9445-67fbcb8198f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e1b379-265a-4423-9f97-24c249258eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:26 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Volume 3a81fc95-7bb2-4372-bab3-2b5891035858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a81fc95-7bb2-4372-bab3-2b5891035858', 'volume_size': 1} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-180735928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a81fc95-7bb2-4372-bab3-2b5891035858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f0ba613c4b142f2935e86e828d46632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:26Z,use_quota=True,user_id='ae4e1facc6e14df4a19b174308de2df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Creating volume 3a81fc95-7bb2-4372-bab3-2b5891035858 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:12:26 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a81fc95-7bb2-4372-bab3-2b5891035858 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:26 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a81fc95-7bb2-4372-bab3-2b5891035858 1073741824 Sep 17 15:12:26 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Flow 'volume_create_manager' (c3197001-d582-4a6c-96fd-27da43694e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2aa6a4-e3b2-4b72-ac14-ed1823d51623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-8ad676c7-2e73-40fb-92de-d66e541ce7dc req-b898586e-b860-4384-8475-fa4409292d72 tempest-TestShelveInstance-61082965 None] Terminate volume connection completed successfully. Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-8ad676c7-2e73-40fb-92de-d66e541ce7dc req-b898586e-b860-4384-8475-fa4409292d72 tempest-TestShelveInstance-61082965 None] Deleting attachment a4e79d03-ee17-4a5f-be51-c2131de51b1c. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2aa6a4-e3b2-4b72-ac14-ed1823d51623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-76618778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5232cc80-4bfe-48a2-a863-491ec8cf1c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f0ba613c4b142f2935e86e828d46632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:27Z,use_quota=True,user_id='ae4e1facc6e14df4a19b174308de2df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72850c69-b976-4901-92b2-579c42ab9796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72850c69-b976-4901-92b2-579c42ab9796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7afdfc-cd6a-47d1-a5c6-eba32470cc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7afdfc-cd6a-47d1-a5c6-eba32470cc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5232cc80-4bfe-48a2-a863-491ec8cf1c17', 'volume_name': 'volume-5232cc80-4bfe-48a2-a863-491ec8cf1c17', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c169fd-04f6-4b03-97f3-81d158215613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c169fd-04f6-4b03-97f3-81d158215613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c1a7bd-1620-4955-93ce-6a06bfba6cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:27 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Volume 5232cc80-4bfe-48a2-a863-491ec8cf1c17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5232cc80-4bfe-48a2-a863-491ec8cf1c17', 'volume_size': 1} Sep 17 15:12:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:27 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a81fc95-7bb2-4372-bab3-2b5891035858 1073741824" returned: 0 in 1.124s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a81fc95-7bb2-4372-bab3-2b5891035858 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:27 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a81fc95-7bb2-4372-bab3-2b5891035858 Sep 17 15:12:27 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:27 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:12:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Flow 'volume_create_manager' (937e5239-781a-450a-8766-b53258374153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29034863-08e9-4710-bc3a-1f312d91028c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29034863-08e9-4710-bc3a-1f312d91028c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-810800963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d8fc76-b07f-4275-8f49-cbfd19bf6e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f0ba613c4b142f2935e86e828d46632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:28Z,use_quota=True,user_id='ae4e1facc6e14df4a19b174308de2df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5194a7a5-44b6-4423-ad6c-f53548ab1c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5194a7a5-44b6-4423-ad6c-f53548ab1c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e784fe7d-fc78-4d1c-ac6d-34d2b4db23d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e784fe7d-fc78-4d1c-ac6d-34d2b4db23d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00d8fc76-b07f-4275-8f49-cbfd19bf6e19', 'volume_name': 'volume-00d8fc76-b07f-4275-8f49-cbfd19bf6e19', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2877afdf-a4ef-4b10-aca0-a58edfc1f3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2877afdf-a4ef-4b10-aca0-a58edfc1f3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c100813-28f4-4500-bda1-23dc7ddb1141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:28 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Volume 00d8fc76-b07f-4275-8f49-cbfd19bf6e19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00d8fc76-b07f-4275-8f49-cbfd19bf6e19', 'volume_size': 1} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:28 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a81fc95-7bb2-4372-bab3-2b5891035858" returned: 0 in 0.694s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.240s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-76618778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5232cc80-4bfe-48a2-a863-491ec8cf1c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f0ba613c4b142f2935e86e828d46632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:27Z,use_quota=True,user_id='ae4e1facc6e14df4a19b174308de2df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Creating volume 5232cc80-4bfe-48a2-a863-491ec8cf1c17 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:12:28 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5232cc80-4bfe-48a2-a863-491ec8cf1c17 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:28 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5232cc80-4bfe-48a2-a863-491ec8cf1c17 1073741824 Sep 17 15:12:28 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19e1b379-265a-4423-9f97-24c249258eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a81fc95-7bb2-4372-bab3-2b5891035858', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8489a4df-a9c9-42c4-ae21-9c066d6b1fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:28 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Volume volume-3a81fc95-7bb2-4372-bab3-2b5891035858 (3a81fc95-7bb2-4372-bab3-2b5891035858): created successfully Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8489a4df-a9c9-42c4-ae21-9c066d6b1fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Flow 'volume_create_manager' (c9e3601c-cfa7-493b-b9bd-26c7d493c4ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b716fa93-bd42-4538-9aa8-d533987e0294 tempest-CreateVolumesFromImageTest-566664897 None] Created volume successfully. Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Flow 'volume_create_manager' (0ccec255-6e56-45a8-b1f1-97454d85f6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03659317-d5b9-482b-800a-323f734d2e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03659317-d5b9-482b-800a-323f734d2e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-619558214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cef9e80-af5c-45d9-a00b-10ab534c8ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f0ba613c4b142f2935e86e828d46632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:29Z,use_quota=True,user_id='ae4e1facc6e14df4a19b174308de2df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35ac996-b85b-4f82-a66e-e49a405346d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e35ac996-b85b-4f82-a66e-e49a405346d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10601886-9859-477a-b1e3-9bf2fc0f941b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10601886-9859-477a-b1e3-9bf2fc0f941b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cef9e80-af5c-45d9-a00b-10ab534c8ae8', 'volume_name': 'volume-2cef9e80-af5c-45d9-a00b-10ab534c8ae8', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d30161-d95d-4e13-9bbb-a09835849a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d30161-d95d-4e13-9bbb-a09835849a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af350ad5-7c7b-448a-9130-28ab72d3109b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:28 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Volume 2cef9e80-af5c-45d9-a00b-10ab534c8ae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cef9e80-af5c-45d9-a00b-10ab534c8ae8', 'volume_size': 1} Sep 17 15:12:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:29 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5232cc80-4bfe-48a2-a863-491ec8cf1c17 1073741824" returned: 0 in 1.156s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5232cc80-4bfe-48a2-a863-491ec8cf1c17 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:29 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5232cc80-4bfe-48a2-a863-491ec8cf1c17 Sep 17 15:12:29 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:29 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:12:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Flow 'volume_create_manager' (c776b580-5dba-484e-8c82-187306dad531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d981c81-f498-4942-98e2-24c4b9fe3566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d981c81-f498-4942-98e2-24c4b9fe3566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1630210536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4123b00-8ecf-4756-b994-2eecaa1c925d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f0ba613c4b142f2935e86e828d46632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:30Z,use_quota=True,user_id='ae4e1facc6e14df4a19b174308de2df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55bd3dcd-84f4-4660-b54c-d0274bea6c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55bd3dcd-84f4-4660-b54c-d0274bea6c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f9d5eb-47f9-42f5-83d0-24cec403901f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f9d5eb-47f9-42f5-83d0-24cec403901f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4123b00-8ecf-4756-b994-2eecaa1c925d', 'volume_name': 'volume-b4123b00-8ecf-4756-b994-2eecaa1c925d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2442d45b-b867-48ef-bda3-8d8914133e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2442d45b-b867-48ef-bda3-8d8914133e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5e3b8e-8d83-4c8e-a213-f4adb60cdde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:29 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Volume b4123b00-8ecf-4756-b994-2eecaa1c925d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4123b00-8ecf-4756-b994-2eecaa1c925d', 'volume_size': 1} Sep 17 15:12:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:30 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5232cc80-4bfe-48a2-a863-491ec8cf1c17" returned: 0 in 0.498s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.855s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-810800963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d8fc76-b07f-4275-8f49-cbfd19bf6e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f0ba613c4b142f2935e86e828d46632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:28Z,use_quota=True,user_id='ae4e1facc6e14df4a19b174308de2df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Creating volume 00d8fc76-b07f-4275-8f49-cbfd19bf6e19 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:12:30 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00d8fc76-b07f-4275-8f49-cbfd19bf6e19 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c1a7bd-1620-4955-93ce-6a06bfba6cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5232cc80-4bfe-48a2-a863-491ec8cf1c17', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:30 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00d8fc76-b07f-4275-8f49-cbfd19bf6e19 1073741824 Sep 17 15:12:30 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d0098b-7db9-457e-b095-f4639b2d3970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:30 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Volume volume-5232cc80-4bfe-48a2-a863-491ec8cf1c17 (5232cc80-4bfe-48a2-a863-491ec8cf1c17): created successfully Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d0098b-7db9-457e-b095-f4639b2d3970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Flow 'volume_create_manager' (c3197001-d582-4a6c-96fd-27da43694e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:30 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-62ab53ce-5ddc-48fb-8a3b-8151f8e9c397 tempest-CreateVolumesFromImageTest-566664897 None] Created volume successfully. Sep 17 15:12:30 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00d8fc76-b07f-4275-8f49-cbfd19bf6e19 1073741824" returned: 0 in 0.741s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00d8fc76-b07f-4275-8f49-cbfd19bf6e19 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:30 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00d8fc76-b07f-4275-8f49-cbfd19bf6e19 Sep 17 15:12:30 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:31 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00d8fc76-b07f-4275-8f49-cbfd19bf6e19" returned: 0 in 0.336s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.311s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-619558214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cef9e80-af5c-45d9-a00b-10ab534c8ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f0ba613c4b142f2935e86e828d46632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:29Z,use_quota=True,user_id='ae4e1facc6e14df4a19b174308de2df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Creating volume 2cef9e80-af5c-45d9-a00b-10ab534c8ae8 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:12:31 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2cef9e80-af5c-45d9-a00b-10ab534c8ae8 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c100813-28f4-4500-bda1-23dc7ddb1141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00d8fc76-b07f-4275-8f49-cbfd19bf6e19', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963f11d1-785b-419f-9f22-b472d4eb8393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:31 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2cef9e80-af5c-45d9-a00b-10ab534c8ae8 1073741824 Sep 17 15:12:31 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:31 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Volume volume-00d8fc76-b07f-4275-8f49-cbfd19bf6e19 (00d8fc76-b07f-4275-8f49-cbfd19bf6e19): created successfully Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963f11d1-785b-419f-9f22-b472d4eb8393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Flow 'volume_create_manager' (937e5239-781a-450a-8766-b53258374153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2366b13c-c826-4284-a69a-56900645b6e6 tempest-CreateVolumesFromImageTest-566664897 None] Created volume successfully. Sep 17 15:12:31 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2cef9e80-af5c-45d9-a00b-10ab534c8ae8 1073741824" returned: 0 in 0.753s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2cef9e80-af5c-45d9-a00b-10ab534c8ae8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-47b54490-493e-4cd8-963d-e07fcdae4dac req-487fd4dd-764f-445e-bb09-08e8d8d0e243 tempest-TestShelveInstance-61082965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:32 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2cef9e80-af5c-45d9-a00b-10ab534c8ae8 Sep 17 15:12:32 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:32 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2cef9e80-af5c-45d9-a00b-10ab534c8ae8" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.354s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1630210536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4123b00-8ecf-4756-b994-2eecaa1c925d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f0ba613c4b142f2935e86e828d46632',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:30Z,use_quota=True,user_id='ae4e1facc6e14df4a19b174308de2df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Creating volume b4123b00-8ecf-4756-b994-2eecaa1c925d {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:12:32 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b4123b00-8ecf-4756-b994-2eecaa1c925d 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af350ad5-7c7b-448a-9130-28ab72d3109b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cef9e80-af5c-45d9-a00b-10ab534c8ae8', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0764208-1ff0-4ecd-bbae-69c9fce1ab67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:32 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b4123b00-8ecf-4756-b994-2eecaa1c925d 1073741824 Sep 17 15:12:32 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:32 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Volume volume-2cef9e80-af5c-45d9-a00b-10ab534c8ae8 (2cef9e80-af5c-45d9-a00b-10ab534c8ae8): created successfully Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0764208-1ff0-4ecd-bbae-69c9fce1ab67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Flow 'volume_create_manager' (0ccec255-6e56-45a8-b1f1-97454d85f6b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:32 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3413c364-c81d-4949-9974-5598e1d95815 tempest-CreateVolumesFromImageTest-566664897 None] Created volume successfully. Sep 17 15:12:32 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b4123b00-8ecf-4756-b994-2eecaa1c925d 1073741824" returned: 0 in 0.536s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b4123b00-8ecf-4756-b994-2eecaa1c925d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:32 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b4123b00-8ecf-4756-b994-2eecaa1c925d Sep 17 15:12:32 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:33 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b4123b00-8ecf-4756-b994-2eecaa1c925d" returned: 0 in 0.343s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:12:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-47b54490-493e-4cd8-963d-e07fcdae4dac req-487fd4dd-764f-445e-bb09-08e8d8d0e243 tempest-TestShelveInstance-61082965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.206s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5e3b8e-8d83-4c8e-a213-f4adb60cdde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4123b00-8ecf-4756-b994-2eecaa1c925d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b392b1-f4d9-4305-b4a0-d12904bb5720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-47b54490-493e-4cd8-963d-e07fcdae4dac req-487fd4dd-764f-445e-bb09-08e8d8d0e243 tempest-TestShelveInstance-61082965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:33 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Volume volume-b4123b00-8ecf-4756-b994-2eecaa1c925d (b4123b00-8ecf-4756-b994-2eecaa1c925d): created successfully Sep 17 15:12:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b392b1-f4d9-4305-b4a0-d12904bb5720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Flow 'volume_create_manager' (c776b580-5dba-484e-8c82-187306dad531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8c3efee5-6301-4256-8246-7d21976460dd tempest-CreateVolumesFromImageTest-566664897 None] Created volume successfully. Sep 17 15:12:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-47b54490-493e-4cd8-963d-e07fcdae4dac req-487fd4dd-764f-445e-bb09-08e8d8d0e243 tempest-TestShelveInstance-61082965 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-bae1d3fa-6b7f-4f50-917a-f1753809be78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '042f7a27-a31b-4319-a1a4-64d7c651fd9e', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:12:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-47b54490-493e-4cd8-963d-e07fcdae4dac req-487fd4dd-764f-445e-bb09-08e8d8d0e243 tempest-TestShelveInstance-61082965 None] attachment_update completed successfully. Sep 17 15:12:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "cinder-b4123b00-8ecf-4756-b994-2eecaa1c925d-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-b4123b00-8ecf-4756-b994-2eecaa1c925d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "cinder-quobyte-b4123b00-8ecf-4756-b994-2eecaa1c925d" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-quobyte-b4123b00-8ecf-4756-b994-2eecaa1c925d" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:34 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd33ef2-1441-4723-8ba9-fbd48b7bad95]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b4123b00-8ecf-4756-b994-2eecaa1c925d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:34 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b4123b00-8ecf-4756-b994-2eecaa1c925d Sep 17 15:12:34 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:34 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b4123b00-8ecf-4756-b994-2eecaa1c925d" returned: 0 in 0.459s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b4123b00-8ecf-4756-b994-2eecaa1c925d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:34 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b4123b00-8ecf-4756-b994-2eecaa1c925d Sep 17 15:12:34 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:35 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b4123b00-8ecf-4756-b994-2eecaa1c925d" returned: 0 in 0.273s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-quobyte-b4123b00-8ecf-4756-b994-2eecaa1c925d" released by "delete_volume" :: held 0.830s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:35 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] Created reservations ['79e07ac5-5e55-4291-af0b-fb21be9724b8', '927b14ec-b753-483e-b1ce-748fe68c603f', '33128d2c-45e6-4cee-8e3f-dc751df42f14', '17adde6b-3214-4dbc-b95c-a6d9cf32e68b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:12:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:35 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:12:35 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "cinder-2cef9e80-af5c-45d9-a00b-10ab534c8ae8-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-2cef9e80-af5c-45d9-a00b-10ab534c8ae8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "cinder-quobyte-2cef9e80-af5c-45d9-a00b-10ab534c8ae8" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-quobyte-2cef9e80-af5c-45d9-a00b-10ab534c8ae8" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:35 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d434310c-4fbe-47fb-b74b-5173bdf01a62]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2cef9e80-af5c-45d9-a00b-10ab534c8ae8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:35 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.411s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:35 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:35 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] Deleted volume successfully. Sep 17 15:12:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d6af4dd3-8c5f-49f3-a20a-fd0b61b0626b tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-b4123b00-8ecf-4756-b994-2eecaa1c925d-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:35 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2cef9e80-af5c-45d9-a00b-10ab534c8ae8 Sep 17 15:12:35 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:36 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2cef9e80-af5c-45d9-a00b-10ab534c8ae8" returned: 0 in 0.510s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2cef9e80-af5c-45d9-a00b-10ab534c8ae8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:36 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2cef9e80-af5c-45d9-a00b-10ab534c8ae8 Sep 17 15:12:36 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:36 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2cef9e80-af5c-45d9-a00b-10ab534c8ae8" returned: 0 in 0.551s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-quobyte-2cef9e80-af5c-45d9-a00b-10ab534c8ae8" released by "delete_volume" :: held 1.154s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:36 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] Created reservations ['c71c9b7c-d4c2-4f1e-9c44-4c5f42114065', 'c9f47484-7173-4803-9105-4dd662862fc5', 'bfc6c021-7507-4eb1-a5b8-4088f1866d1c', '2ac49c5d-0f99-4df2-ad59-1107a9d6b673'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:12:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:37 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:12:37 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:37 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.474s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:37 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] Deleted volume successfully. Sep 17 15:12:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f1c2dcbe-773f-418b-a237-07f5c8a8911a tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-2cef9e80-af5c-45d9-a00b-10ab534c8ae8-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "cinder-00d8fc76-b07f-4275-8f49-cbfd19bf6e19-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-00d8fc76-b07f-4275-8f49-cbfd19bf6e19-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "cinder-quobyte-00d8fc76-b07f-4275-8f49-cbfd19bf6e19" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-quobyte-00d8fc76-b07f-4275-8f49-cbfd19bf6e19" acquired by "delete_volume" :: waited 0.035s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:38 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e11148-69c8-4890-832b-e5b2fdb936bd]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00d8fc76-b07f-4275-8f49-cbfd19bf6e19 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:38 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00d8fc76-b07f-4275-8f49-cbfd19bf6e19 Sep 17 15:12:38 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:38 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00d8fc76-b07f-4275-8f49-cbfd19bf6e19" returned: 0 in 0.403s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00d8fc76-b07f-4275-8f49-cbfd19bf6e19 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:38 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00d8fc76-b07f-4275-8f49-cbfd19bf6e19 Sep 17 15:12:38 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:38 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-00d8fc76-b07f-4275-8f49-cbfd19bf6e19" returned: 0 in 0.337s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-quobyte-00d8fc76-b07f-4275-8f49-cbfd19bf6e19" released by "delete_volume" :: held 0.802s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:39 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] Created reservations ['447e7d32-fd87-4903-b413-04540675b3da', '0e467016-cda3-4c25-8f04-728541a8a163', '09ca2543-0828-4931-b041-9410995eedae', '65945335-d2ec-4352-9f61-e38f62901278'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:12:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:39 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:12:39 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "cinder-5232cc80-4bfe-48a2-a863-491ec8cf1c17-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-5232cc80-4bfe-48a2-a863-491ec8cf1c17-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "cinder-quobyte-5232cc80-4bfe-48a2-a863-491ec8cf1c17" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-quobyte-5232cc80-4bfe-48a2-a863-491ec8cf1c17" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:39 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.325s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:39 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:39 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0479e4-787c-45a7-8c0d-4882180e9100]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5232cc80-4bfe-48a2-a863-491ec8cf1c17 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:39 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] Deleted volume successfully. Sep 17 15:12:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1926c18-78df-4c0b-ab18-bb20b54a1b44 tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-00d8fc76-b07f-4275-8f49-cbfd19bf6e19-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:39 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5232cc80-4bfe-48a2-a863-491ec8cf1c17 Sep 17 15:12:39 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:39 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5232cc80-4bfe-48a2-a863-491ec8cf1c17" returned: 0 in 0.429s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5232cc80-4bfe-48a2-a863-491ec8cf1c17 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:39 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5232cc80-4bfe-48a2-a863-491ec8cf1c17 Sep 17 15:12:39 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:40 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5232cc80-4bfe-48a2-a863-491ec8cf1c17" returned: 0 in 0.312s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-quobyte-5232cc80-4bfe-48a2-a863-491ec8cf1c17" released by "delete_volume" :: held 0.815s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] Created reservations ['52870dc5-1dd4-4498-934a-da1a81ed3e77', '45799177-8cac-47e6-855e-b60a57324949', 'a00fcad3-4f66-4d1f-8863-2037af4dd62c', 'cc274b90-e7a9-4b76-88eb-9002b0b3102e'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:40 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:12:40 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "cinder-3a81fc95-7bb2-4372-bab3-2b5891035858-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:40 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:12:40 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-3a81fc95-7bb2-4372-bab3-2b5891035858-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "cinder-quobyte-3a81fc95-7bb2-4372-bab3-2b5891035858" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-quobyte-3a81fc95-7bb2-4372-bab3-2b5891035858" acquired by "delete_volume" :: waited 0.042s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[88917f26-74db-4623-9352-71679c4d734f]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a81fc95-7bb2-4372-bab3-2b5891035858 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:40 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.394s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:40 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] Deleted volume successfully. Sep 17 15:12:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a245dea8-b85f-45c8-843a-235679c74637 tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-5232cc80-4bfe-48a2-a863-491ec8cf1c17-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:40 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a81fc95-7bb2-4372-bab3-2b5891035858 Sep 17 15:12:40 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:41 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.680s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:41 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:41 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:12:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:12:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:12:41 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a81fc95-7bb2-4372-bab3-2b5891035858" returned: 0 in 0.474s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a81fc95-7bb2-4372-bab3-2b5891035858 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:41 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a81fc95-7bb2-4372-bab3-2b5891035858 Sep 17 15:12:41 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:41 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3a81fc95-7bb2-4372-bab3-2b5891035858" returned: 0 in 0.321s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-quobyte-3a81fc95-7bb2-4372-bab3-2b5891035858" released by "delete_volume" :: held 0.878s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:41 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] Created reservations ['1b399c64-b297-4c37-b49a-355aaf662576', 'a3d372e3-b915-4c16-b583-e5c7149b4a58', '40c57b1d-da8e-42b8-9691-0effde3caa18', '1a46c78a-6b51-4c5c-bc1d-e903c6f13494'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:12:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:41 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:12:41 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:42 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.251s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:42 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:42 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] Deleted volume successfully. Sep 17 15:12:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-27f28906-ef67-4a7e-806d-3cecdffbb160 tempest-CreateVolumesFromImageTest-566664897 None] Lock "cinder-3a81fc95-7bb2-4372-bab3-2b5891035858-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Flow 'volume_create_manager' (b35cdd71-df52-4cc2-ad8d-b0bbe03aab5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6df66c-f918-4e0b-83af-443a38e1fe15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6df66c-f918-4e0b-83af-443a38e1fe15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-232384751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d59f78d-fa08-41cb-a6d1-519770209381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f525a19031f4756afb9b7bcf2433b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:46Z,use_quota=True,user_id='8b309d9524394dd09aeacdb0f66190ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6308a762-d20b-4144-b3fd-99d2ef7f1b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6308a762-d20b-4144-b3fd-99d2ef7f1b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39dfcbf3-4416-442f-82d1-028df404fcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39dfcbf3-4416-442f-82d1-028df404fcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d59f78d-fa08-41cb-a6d1-519770209381', 'volume_name': 'volume-7d59f78d-fa08-41cb-a6d1-519770209381', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8223364b-64dc-40da-ba41-144a16f2b98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8223364b-64dc-40da-ba41-144a16f2b98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23099de3-aeb6-4b5f-b4a1-fe43f1ad9718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:45 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Volume 7d59f78d-fa08-41cb-a6d1-519770209381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d59f78d-fa08-41cb-a6d1-519770209381', 'volume_size': 1} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-232384751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d59f78d-fa08-41cb-a6d1-519770209381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f525a19031f4756afb9b7bcf2433b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:46Z,use_quota=True,user_id='8b309d9524394dd09aeacdb0f66190ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Creating volume 7d59f78d-fa08-41cb-a6d1-519770209381 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:12:45 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:12:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7d59f78d-fa08-41cb-a6d1-519770209381 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:45 devstack sudo[104354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7d59f78d-fa08-41cb-a6d1-519770209381 1073741824 Sep 17 15:12:45 devstack sudo[104354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:46 devstack sudo[104354]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7d59f78d-fa08-41cb-a6d1-519770209381 1073741824" returned: 0 in 0.411s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7d59f78d-fa08-41cb-a6d1-519770209381 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:46 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7d59f78d-fa08-41cb-a6d1-519770209381 Sep 17 15:12:46 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:46 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7d59f78d-fa08-41cb-a6d1-519770209381" returned: 0 in 0.236s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:12:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23099de3-aeb6-4b5f-b4a1-fe43f1ad9718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d59f78d-fa08-41cb-a6d1-519770209381', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b50968b-9f59-4cc4-b99d-0a14fec7665c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:46 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Volume volume-7d59f78d-fa08-41cb-a6d1-519770209381 (7d59f78d-fa08-41cb-a6d1-519770209381): created successfully Sep 17 15:12:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b50968b-9f59-4cc4-b99d-0a14fec7665c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Flow 'volume_create_manager' (b35cdd71-df52-4cc2-ad8d-b0bbe03aab5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ba37562d-d800-4663-a102-1498d5406a1b tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Created volume successfully. Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Flow 'volume_create_manager' (815cbcc6-e5b6-4d6d-8705-73cc7d00d793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (741da07c-f48b-419b-ac66-29710fc46556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (741da07c-f48b-419b-ac66-29710fc46556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1523421256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30c69d1-a525-4be7-94c4-123efea97fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f525a19031f4756afb9b7bcf2433b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:47Z,use_quota=True,user_id='8b309d9524394dd09aeacdb0f66190ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443e05d6-8aa8-4745-ad7d-c0356c9dc77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (443e05d6-8aa8-4745-ad7d-c0356c9dc77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb61f4c-b292-49a6-ad21-84548821ab47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb61f4c-b292-49a6-ad21-84548821ab47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e30c69d1-a525-4be7-94c4-123efea97fba', 'volume_name': 'volume-e30c69d1-a525-4be7-94c4-123efea97fba', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7d2cbf-e94e-4d0e-aa87-206fb61d7fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7d2cbf-e94e-4d0e-aa87-206fb61d7fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (835f1999-377c-44f1-aef4-3306e081fab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:47 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Volume e30c69d1-a525-4be7-94c4-123efea97fba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e30c69d1-a525-4be7-94c4-123efea97fba', 'volume_size': 1} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1523421256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30c69d1-a525-4be7-94c4-123efea97fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f525a19031f4756afb9b7bcf2433b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:47Z,use_quota=True,user_id='8b309d9524394dd09aeacdb0f66190ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Creating volume e30c69d1-a525-4be7-94c4-123efea97fba {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:12:47 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e30c69d1-a525-4be7-94c4-123efea97fba 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:47 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e30c69d1-a525-4be7-94c4-123efea97fba 1073741824 Sep 17 15:12:47 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Flow 'volume_create_manager' (66b23e10-43e1-47be-86b8-cbf3e6666e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df2df222-1b65-4d6a-9029-adbf7db80300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df2df222-1b65-4d6a-9029-adbf7db80300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-802701518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43bcddbf-d2dd-4e77-bd79-82b4fe8038ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f525a19031f4756afb9b7bcf2433b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:48Z,use_quota=True,user_id='8b309d9524394dd09aeacdb0f66190ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ca2912-f2f9-4021-ab13-2eb6a71d4d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ca2912-f2f9-4021-ab13-2eb6a71d4d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a200ad1-de1e-4f2a-9493-bd22774fcf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a200ad1-de1e-4f2a-9493-bd22774fcf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43bcddbf-d2dd-4e77-bd79-82b4fe8038ed', 'volume_name': 'volume-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d176c5af-cede-4c91-9ab2-d412faa47e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d176c5af-cede-4c91-9ab2-d412faa47e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6209a166-4f09-4386-b9b9-b7c0197bb2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:47 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Volume 43bcddbf-d2dd-4e77-bd79-82b4fe8038ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed', 'volume_size': 1} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:47 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e30c69d1-a525-4be7-94c4-123efea97fba 1073741824" returned: 0 in 0.640s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e30c69d1-a525-4be7-94c4-123efea97fba {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:47 devstack sudo[104368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e30c69d1-a525-4be7-94c4-123efea97fba Sep 17 15:12:47 devstack sudo[104368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Flow 'volume_create_manager' (9aa08f99-6ecb-4f71-a191-34c2e86d1704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f8181f-699c-4981-93a5-663e1a4ebf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f8181f-699c-4981-93a5-663e1a4ebf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1099603386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3600210-b28b-45cc-bf86-8fdf179450e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f525a19031f4756afb9b7bcf2433b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:48Z,use_quota=True,user_id='8b309d9524394dd09aeacdb0f66190ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3435b4-a14f-403e-b515-b0620c7c833b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3435b4-a14f-403e-b515-b0620c7c833b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83c4b1b-b029-4629-90a5-1471540ec77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83c4b1b-b029-4629-90a5-1471540ec77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3600210-b28b-45cc-bf86-8fdf179450e0', 'volume_name': 'volume-f3600210-b28b-45cc-bf86-8fdf179450e0', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa620a8-3541-4f81-a392-f0c8403aa3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa620a8-3541-4f81-a392-f0c8403aa3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f14fca-6acb-4e40-abf9-64deaa95d732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:48 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Volume f3600210-b28b-45cc-bf86-8fdf179450e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3600210-b28b-45cc-bf86-8fdf179450e0', 'volume_size': 1} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:48 devstack sudo[104368]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e30c69d1-a525-4be7-94c4-123efea97fba" returned: 0 in 0.399s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.635s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-802701518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43bcddbf-d2dd-4e77-bd79-82b4fe8038ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f525a19031f4756afb9b7bcf2433b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:48Z,use_quota=True,user_id='8b309d9524394dd09aeacdb0f66190ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Creating volume 43bcddbf-d2dd-4e77-bd79-82b4fe8038ed {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:12:48 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (835f1999-377c-44f1-aef4-3306e081fab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e30c69d1-a525-4be7-94c4-123efea97fba', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6121cfdb-390a-4972-964a-575e91010c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:48 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed 1073741824 Sep 17 15:12:48 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:48 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Volume volume-e30c69d1-a525-4be7-94c4-123efea97fba (e30c69d1-a525-4be7-94c4-123efea97fba): created successfully Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6121cfdb-390a-4972-964a-575e91010c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Flow 'volume_create_manager' (815cbcc6-e5b6-4d6d-8705-73cc7d00d793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:48 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c6018825-2bf7-4568-9d89-401329782ee2 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Created volume successfully. Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Flow 'volume_create_manager' (03e9820a-d6be-483a-97a1-adb86a0906ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de197028-3583-49aa-a2f4-f290796d3c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de197028-3583-49aa-a2f4-f290796d3c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-45797284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fcc9ef-59d7-4cb6-be49-e049648cc25c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f525a19031f4756afb9b7bcf2433b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:48Z,use_quota=True,user_id='8b309d9524394dd09aeacdb0f66190ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f33c747-2565-41c9-a472-95ef8c70a33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f33c747-2565-41c9-a472-95ef8c70a33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a570e66-0a00-43db-8004-1252dd377cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a570e66-0a00-43db-8004-1252dd377cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92fcc9ef-59d7-4cb6-be49-e049648cc25c', 'volume_name': 'volume-92fcc9ef-59d7-4cb6-be49-e049648cc25c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c853a3d0-0bc1-4dd7-a48a-0beb09c47d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c853a3d0-0bc1-4dd7-a48a-0beb09c47d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a7b329-cfd8-4427-97fe-be6351d7f9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:48 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Volume 92fcc9ef-59d7-4cb6-be49-e049648cc25c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92fcc9ef-59d7-4cb6-be49-e049648cc25c', 'volume_size': 1} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Flow 'volume_create_manager' (3b950cdf-1d4a-46b0-b870-a2fcdeccacfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dea0a60-5f44-42c6-b107-fa07c594a4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dea0a60-5f44-42c6-b107-fa07c594a4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-719001127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3f6548-f92c-4c75-be05-00a65c541bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f525a19031f4756afb9b7bcf2433b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:49Z,use_quota=True,user_id='8b309d9524394dd09aeacdb0f66190ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09924fd-d54e-40f9-bac8-eef6878d8e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09924fd-d54e-40f9-bac8-eef6878d8e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9258e520-8f2e-49df-9b53-e3624e8002d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9258e520-8f2e-49df-9b53-e3624e8002d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3f6548-f92c-4c75-be05-00a65c541bde', 'volume_name': 'volume-9c3f6548-f92c-4c75-be05-00a65c541bde', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b74d097b-4e23-4e51-98fb-4c226a3adb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:49 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b74d097b-4e23-4e51-98fb-4c226a3adb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148820ef-27f9-495f-8420-19a3034a856b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:49 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Volume 9c3f6548-f92c-4c75-be05-00a65c541bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3f6548-f92c-4c75-be05-00a65c541bde', 'volume_size': 1} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed 1073741824" returned: 0 in 0.686s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:49 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed Sep 17 15:12:49 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:49 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.180s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1099603386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3600210-b28b-45cc-bf86-8fdf179450e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f525a19031f4756afb9b7bcf2433b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:48Z,use_quota=True,user_id='8b309d9524394dd09aeacdb0f66190ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Creating volume f3600210-b28b-45cc-bf86-8fdf179450e0 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:12:49 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f3600210-b28b-45cc-bf86-8fdf179450e0 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6209a166-4f09-4386-b9b9-b7c0197bb2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:49 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f3600210-b28b-45cc-bf86-8fdf179450e0 1073741824 Sep 17 15:12:49 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c252eeb3-54f9-4506-856b-e9308c3ec707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:49 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Volume volume-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed (43bcddbf-d2dd-4e77-bd79-82b4fe8038ed): created successfully Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c252eeb3-54f9-4506-856b-e9308c3ec707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Flow 'volume_create_manager' (66b23e10-43e1-47be-86b8-cbf3e6666e69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:49 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6b20f0b3-fe4e-4206-a252-9799a1d1c430 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Created volume successfully. Sep 17 15:12:49 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f3600210-b28b-45cc-bf86-8fdf179450e0 1073741824" returned: 0 in 0.573s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f3600210-b28b-45cc-bf86-8fdf179450e0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:50 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f3600210-b28b-45cc-bf86-8fdf179450e0 Sep 17 15:12:50 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:50 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f3600210-b28b-45cc-bf86-8fdf179450e0" returned: 0 in 0.309s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.730s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-45797284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fcc9ef-59d7-4cb6-be49-e049648cc25c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f525a19031f4756afb9b7bcf2433b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:48Z,use_quota=True,user_id='8b309d9524394dd09aeacdb0f66190ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Creating volume 92fcc9ef-59d7-4cb6-be49-e049648cc25c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:12:50 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-92fcc9ef-59d7-4cb6-be49-e049648cc25c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f14fca-6acb-4e40-abf9-64deaa95d732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3600210-b28b-45cc-bf86-8fdf179450e0', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (091f5b07-421c-424b-9715-a1f8115c4887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:50 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-92fcc9ef-59d7-4cb6-be49-e049648cc25c 1073741824 Sep 17 15:12:50 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:50 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Volume volume-f3600210-b28b-45cc-bf86-8fdf179450e0 (f3600210-b28b-45cc-bf86-8fdf179450e0): created successfully Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (091f5b07-421c-424b-9715-a1f8115c4887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Flow 'volume_create_manager' (9aa08f99-6ecb-4f71-a191-34c2e86d1704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2bd533ae-b69e-4805-85f0-0d563e1d6cb4 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Created volume successfully. Sep 17 15:12:50 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-92fcc9ef-59d7-4cb6-be49-e049648cc25c 1073741824" returned: 0 in 0.477s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-92fcc9ef-59d7-4cb6-be49-e049648cc25c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:50 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-92fcc9ef-59d7-4cb6-be49-e049648cc25c Sep 17 15:12:50 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:51 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-92fcc9ef-59d7-4cb6-be49-e049648cc25c" returned: 0 in 0.281s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.078s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-719001127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3f6548-f92c-4c75-be05-00a65c541bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f525a19031f4756afb9b7bcf2433b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:49Z,use_quota=True,user_id='8b309d9524394dd09aeacdb0f66190ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Creating volume 9c3f6548-f92c-4c75-be05-00a65c541bde {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:12:51 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c3f6548-f92c-4c75-be05-00a65c541bde 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a7b329-cfd8-4427-97fe-be6351d7f9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92fcc9ef-59d7-4cb6-be49-e049648cc25c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:51 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c3f6548-f92c-4c75-be05-00a65c541bde 1073741824 Sep 17 15:12:51 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee6cc09-c3af-4cf6-8f88-f6b868dcfa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Volume volume-92fcc9ef-59d7-4cb6-be49-e049648cc25c (92fcc9ef-59d7-4cb6-be49-e049648cc25c): created successfully Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee6cc09-c3af-4cf6-8f88-f6b868dcfa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Flow 'volume_create_manager' (03e9820a-d6be-483a-97a1-adb86a0906ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-cfeb028d-c06b-4dad-b428-beb0432c5039 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Created volume successfully. Sep 17 15:12:51 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c3f6548-f92c-4c75-be05-00a65c541bde 1073741824" returned: 0 in 0.480s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c3f6548-f92c-4c75-be05-00a65c541bde {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:51 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c3f6548-f92c-4c75-be05-00a65c541bde Sep 17 15:12:51 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:51 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c3f6548-f92c-4c75-be05-00a65c541bde" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148820ef-27f9-495f-8420-19a3034a856b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3f6548-f92c-4c75-be05-00a65c541bde', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f382985-67e3-4dfc-9f43-0ec06480a50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Volume volume-9c3f6548-f92c-4c75-be05-00a65c541bde (9c3f6548-f92c-4c75-be05-00a65c541bde): created successfully Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f382985-67e3-4dfc-9f43-0ec06480a50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Flow 'volume_create_manager' (3b950cdf-1d4a-46b0-b870-a2fcdeccacfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c5a17fee-064c-4b25-a683-da2524175c47 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Created volume successfully. Sep 17 15:12:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "cinder-9c3f6548-f92c-4c75-be05-00a65c541bde-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-9c3f6548-f92c-4c75-be05-00a65c541bde-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "cinder-quobyte-9c3f6548-f92c-4c75-be05-00a65c541bde" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-quobyte-9c3f6548-f92c-4c75-be05-00a65c541bde" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:52 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1183fd75-be98-45fc-aaac-ac228292f3be]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c3f6548-f92c-4c75-be05-00a65c541bde {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:52 devstack sudo[104407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c3f6548-f92c-4c75-be05-00a65c541bde Sep 17 15:12:52 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:52 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c3f6548-f92c-4c75-be05-00a65c541bde" returned: 0 in 0.409s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c3f6548-f92c-4c75-be05-00a65c541bde {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:52 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c3f6548-f92c-4c75-be05-00a65c541bde Sep 17 15:12:52 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:53 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-9c3f6548-f92c-4c75-be05-00a65c541bde" returned: 0 in 0.280s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-quobyte-9c3f6548-f92c-4c75-be05-00a65c541bde" released by "delete_volume" :: held 0.741s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:53 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Created reservations ['ae096ef4-cd28-45fd-816c-72dd23a7384d', '1450f521-6e86-46e3-9145-e445e15e859a', 'f718b079-2363-4341-acc4-ab847659c5d9', '0b9212d1-31d6-43b3-bb0d-cd6b15ee9abf'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:12:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:53 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:12:53 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "cinder-92fcc9ef-59d7-4cb6-be49-e049648cc25c-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-92fcc9ef-59d7-4cb6-be49-e049648cc25c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "cinder-quobyte-92fcc9ef-59d7-4cb6-be49-e049648cc25c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-quobyte-92fcc9ef-59d7-4cb6-be49-e049648cc25c" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:53 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[907b16bb-68ae-4381-bfd8-277f1dc334cd]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-92fcc9ef-59d7-4cb6-be49-e049648cc25c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:53 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.419s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:53 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Deleted volume successfully. Sep 17 15:12:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-59415998-14e4-42dc-b04d-20f296b94ba5 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-9c3f6548-f92c-4c75-be05-00a65c541bde-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:54 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-92fcc9ef-59d7-4cb6-be49-e049648cc25c Sep 17 15:12:54 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:54 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-92fcc9ef-59d7-4cb6-be49-e049648cc25c" returned: 0 in 0.587s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-92fcc9ef-59d7-4cb6-be49-e049648cc25c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:54 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-92fcc9ef-59d7-4cb6-be49-e049648cc25c Sep 17 15:12:54 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:54 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-92fcc9ef-59d7-4cb6-be49-e049648cc25c" returned: 0 in 0.362s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-quobyte-92fcc9ef-59d7-4cb6-be49-e049648cc25c" released by "delete_volume" :: held 1.019s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-18e3f664-4fe9-4c2f-8e78-2143e5396351 req-0a8de60d-f410-42bc-9b98-cff4e1e0b243 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-18e3f664-4fe9-4c2f-8e78-2143e5396351 req-0a8de60d-f410-42bc-9b98-cff4e1e0b243 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-18e3f664-4fe9-4c2f-8e78-2143e5396351 req-0a8de60d-f410-42bc-9b98-cff4e1e0b243 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:54 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Created reservations ['c8033064-4531-492e-8cc1-b34d941de4d8', '9e274011-6a73-4163-8c0e-1718e15bc0e1', '3fc6ecef-15d1-4fba-b177-d7223623efb9', 'f925c083-6676-4fdc-a388-90c03e323f26'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:12:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-18e3f664-4fe9-4c2f-8e78-2143e5396351 req-0a8de60d-f410-42bc-9b98-cff4e1e0b243 tempest-TestServerVolumeAttachmentScenario-1395324093 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-d57843b1-ea82-48a3-b8bf-428a7803490c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f84806e-19b6-4451-a0d1-e18fb608f5fc', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:12:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:55 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:12:55 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-18e3f664-4fe9-4c2f-8e78-2143e5396351 req-0a8de60d-f410-42bc-9b98-cff4e1e0b243 tempest-TestServerVolumeAttachmentScenario-1395324093 None] attachment_update completed successfully. Sep 17 15:12:55 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.265s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:55 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Deleted volume successfully. Sep 17 15:12:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d6238884-568f-4cec-b59a-d25e742d22de tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-92fcc9ef-59d7-4cb6-be49-e049648cc25c-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "cinder-f3600210-b28b-45cc-bf86-8fdf179450e0-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-f3600210-b28b-45cc-bf86-8fdf179450e0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "cinder-quobyte-f3600210-b28b-45cc-bf86-8fdf179450e0" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-quobyte-f3600210-b28b-45cc-bf86-8fdf179450e0" acquired by "delete_volume" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:56 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcd8003-ea76-4d9f-86fe-a84d0ea86afc]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f3600210-b28b-45cc-bf86-8fdf179450e0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:56 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f3600210-b28b-45cc-bf86-8fdf179450e0 Sep 17 15:12:56 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:56 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f3600210-b28b-45cc-bf86-8fdf179450e0" returned: 0 in 0.380s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f3600210-b28b-45cc-bf86-8fdf179450e0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:56 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f3600210-b28b-45cc-bf86-8fdf179450e0 Sep 17 15:12:56 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:56 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f3600210-b28b-45cc-bf86-8fdf179450e0" returned: 0 in 0.269s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-quobyte-f3600210-b28b-45cc-bf86-8fdf179450e0" released by "delete_volume" :: held 0.699s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:56 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Created reservations ['915c2b66-e860-441e-8be6-c37a20a9f66b', '6bbb2de8-08a5-4920-84cc-2fb4d6349246', '70ccabd7-0bb4-40f3-a8b6-c86f4b19ee80', '8e515cba-6c19-4eb7-b3e3-cb5e1561e1aa'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:12:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:56 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:12:56 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:57 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.273s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:57 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Deleted volume successfully. Sep 17 15:12:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "cinder-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0618438d-b8c2-42c2-8b1d-70255bb6f978 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-f3600210-b28b-45cc-bf86-8fdf179450e0-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "cinder-quobyte-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-quobyte-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:57 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d7e315-fbf0-4cca-b44e-c8286adbc866]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:57 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed Sep 17 15:12:57 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:57 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed" returned: 0 in 0.390s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:57 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed Sep 17 15:12:57 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:57 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed" returned: 0 in 0.251s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-quobyte-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed" released by "delete_volume" :: held 0.684s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:57 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Created reservations ['c4b2334a-2d28-450f-921a-394bb64b61fe', 'bb057de9-d0ea-46fa-aabe-7bd263898505', '4de6dfdf-2c0b-4836-b45c-9e0a60d5b2a6', 'd2905869-53c7-4d9c-abe4-d6188a3cb274'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:58 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:12:58 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:58 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.287s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "cinder-e30c69d1-a525-4be7-94c4-123efea97fba-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:58 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Deleted volume successfully. Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-e30c69d1-a525-4be7-94c4-123efea97fba-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6647933c-5c0d-470a-8dd0-8796614180fa tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-43bcddbf-d2dd-4e77-bd79-82b4fe8038ed-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "cinder-quobyte-e30c69d1-a525-4be7-94c4-123efea97fba" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-quobyte-e30c69d1-a525-4be7-94c4-123efea97fba" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2307fc1a-43d2-451e-b745-4451d135fd86]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e30c69d1-a525-4be7-94c4-123efea97fba {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:58 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e30c69d1-a525-4be7-94c4-123efea97fba Sep 17 15:12:58 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-9d97efc4-d150-4b70-a34c-98db27c95de0 req-e2418537-06d1-4577-aded-7566e5223e1c tempest-TestServerVolumeAttachmentScenario-1395324093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-9d97efc4-d150-4b70-a34c-98db27c95de0 req-e2418537-06d1-4577-aded-7566e5223e1c tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-9d97efc4-d150-4b70-a34c-98db27c95de0 req-e2418537-06d1-4577-aded-7566e5223e1c tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-9d97efc4-d150-4b70-a34c-98db27c95de0 req-e2418537-06d1-4577-aded-7566e5223e1c tempest-TestServerVolumeAttachmentScenario-1395324093 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813', 'name': 'volume-82dc8306-5b0b-4481-8523-cdcc4c8883b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9da40cf6-03ec-494c-a88d-9d982be68e4a', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:12:58 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-9d97efc4-d150-4b70-a34c-98db27c95de0 req-e2418537-06d1-4577-aded-7566e5223e1c tempest-TestServerVolumeAttachmentScenario-1395324093 None] attachment_update completed successfully. Sep 17 15:12:58 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e30c69d1-a525-4be7-94c4-123efea97fba" returned: 0 in 0.395s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e30c69d1-a525-4be7-94c4-123efea97fba {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:58 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e30c69d1-a525-4be7-94c4-123efea97fba Sep 17 15:12:58 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:59 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e30c69d1-a525-4be7-94c4-123efea97fba" returned: 0 in 0.264s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-quobyte-e30c69d1-a525-4be7-94c4-123efea97fba" released by "delete_volume" :: held 0.712s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:59 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Created reservations ['5d1886bd-ec8c-4fc7-9722-1ba80fc77bcd', '4dca29e4-4000-4cc6-b1f1-3ae787aba8a1', 'f60e4a19-2db0-46fc-a81c-fed382f804b5', '59eb91a8-2a9f-4c4b-82ba-9c613aaf8c61'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:12:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:59 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:12:59 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:59 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.253s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:59 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Deleted volume successfully. Sep 17 15:12:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d7d9c02-7317-4b03-92d1-c2e6e6947f89 tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-e30c69d1-a525-4be7-94c4-123efea97fba-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "cinder-7d59f78d-fa08-41cb-a6d1-519770209381-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-7d59f78d-fa08-41cb-a6d1-519770209381-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "cinder-quobyte-7d59f78d-fa08-41cb-a6d1-519770209381" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-quobyte-7d59f78d-fa08-41cb-a6d1-519770209381" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:59 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[44464e11-d1df-49c0-be40-578b63e98355]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7d59f78d-fa08-41cb-a6d1-519770209381 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:59 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7d59f78d-fa08-41cb-a6d1-519770209381 Sep 17 15:12:59 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:00 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7d59f78d-fa08-41cb-a6d1-519770209381" returned: 0 in 0.386s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7d59f78d-fa08-41cb-a6d1-519770209381 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:00 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7d59f78d-fa08-41cb-a6d1-519770209381 Sep 17 15:13:00 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-4b648ffe-683f-4153-9635-d85f0563eb91 req-a94a5d9d-dcb5-4d30-8c76-e461fb2be3ac tempest-TestServerVolumeAttachmentScenario-1395324093 None] Terminate volume connection completed successfully. Sep 17 15:13:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-4b648ffe-683f-4153-9635-d85f0563eb91 req-a94a5d9d-dcb5-4d30-8c76-e461fb2be3ac tempest-TestServerVolumeAttachmentScenario-1395324093 None] Deleting attachment 9da40cf6-03ec-494c-a88d-9d982be68e4a. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:13:00 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7d59f78d-fa08-41cb-a6d1-519770209381" returned: 0 in 0.251s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-quobyte-7d59f78d-fa08-41cb-a6d1-519770209381" released by "delete_volume" :: held 0.685s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:13:00 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Created reservations ['cc013e27-7845-4f06-bafb-8bc23eb3134b', '12110faf-7dd9-41d1-9f53-3682718f008e', 'a4675ae8-5061-44aa-bd2e-0d3801b702df', 'e87f8db7-c7e7-4dc7-93a9-c3390d84d67b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:13:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:13:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:13:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:00 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:13:00 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:00 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:13:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Deleted volume successfully. Sep 17 15:13:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bc6c9312-5e4b-47ac-a95c-c3b7056646fb tempest-CreateVolumesFromSourceVolumeTest-71424202 None] Lock "cinder-7d59f78d-fa08-41cb-a6d1-519770209381-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:13:01 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-32f1da71-3959-438a-adb8-c2c7e4e82089 req-5cf8ed22-c1d2-462f-bfa9-cbfe9374dc1f tempest-TestServerVolumeAttachmentScenario-1395324093 None] Terminate volume connection completed successfully. Sep 17 15:13:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-32f1da71-3959-438a-adb8-c2c7e4e82089 req-5cf8ed22-c1d2-462f-bfa9-cbfe9374dc1f tempest-TestServerVolumeAttachmentScenario-1395324093 None] Deleting attachment 5f84806e-19b6-4451-a0d1-e18fb608f5fc. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:13:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Acquiring lock "cinder-82dc8306-5b0b-4481-8523-cdcc4c8883b4-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:13:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "cinder-82dc8306-5b0b-4481-8523-cdcc4c8883b4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:13:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Acquiring lock "cinder-quobyte-82dc8306-5b0b-4481-8523-cdcc4c8883b4" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:13:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "cinder-quobyte-82dc8306-5b0b-4481-8523-cdcc4c8883b4" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:13:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97e274f-f103-449c-8ad2-4db398f8539a]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:13:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-82dc8306-5b0b-4481-8523-cdcc4c8883b4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:06 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-82dc8306-5b0b-4481-8523-cdcc4c8883b4 Sep 17 15:13:06 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:06 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=117,cinder:INSERT=40,cinder:UPDATE=137,cinder:DELETE=11 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:13:06 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=153,cinder:SELECT=119,cinder:INSERT=32,cinder:DELETE=15 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:13:06 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:13:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Flow 'volume_create_manager' (37430dc0-4b52-4d03-8965-86668f1a9d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:13:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571ff278-c2df-4934-9918-6cde0d156062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (571ff278-c2df-4934-9918-6cde0d156062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea22992f-81d8-43db-817d-e7ec9f1d31d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2989cc896ed49e1b77916b81efa8937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:13:07Z,use_quota=True,user_id='a03366291be24ae294f6d686f6c4b686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cf2ff6-cf6a-4d52-8940-2e89ac45081c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cf2ff6-cf6a-4d52-8940-2e89ac45081c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (724a9fb2-6af7-4aa8-b095-6a6b2beccd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:06 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:13:06 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-82dc8306-5b0b-4481-8523-cdcc4c8883b4" returned: 0 in 0.395s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-82dc8306-5b0b-4481-8523-cdcc4c8883b4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:06 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-82dc8306-5b0b-4481-8523-cdcc4c8883b4 Sep 17 15:13:06 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (724a9fb2-6af7-4aa8-b095-6a6b2beccd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ea22992f-81d8-43db-817d-e7ec9f1d31d8', 'volume_name': 'volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8', 'volume_size': 1, 'image_id': 'f7d47fdd-f496-4bcb-9172-8dd0f2c51750', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7d47fdd-f496-4bcb-9172-8dd0f2c51750', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b6bbc2166efdba8b5c85eebeae7b71f9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b2989cc896ed49e1b77916b81efa8937', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e0d6749f534043693e20e84a1fb5aa397a82b1d92c747a8f3e0ec46a941fe31c1d5aa89d0cbcc1e0a629ed65dba397004f9333156f4291e8a8a6acb321ed174c', 'id': 'f7d47fdd-f496-4bcb-9172-8dd0f2c51750', 'created_at': datetime.datetime(2026, 9, 17, 13, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7d47fdd-f496-4bcb-9172-8dd0f2c51750/file', 'properties': {}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c60ac7-bdab-4277-805e-cc903cf79240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c60ac7-bdab-4277-805e-cc903cf79240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2631276f-5880-4f2f-a131-b6cbf2eacf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:07 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Volume ea22992f-81d8-43db-817d-e7ec9f1d31d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8', 'volume_size': 1, 'image_id': 'f7d47fdd-f496-4bcb-9172-8dd0f2c51750', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7d47fdd-f496-4bcb-9172-8dd0f2c51750', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b6bbc2166efdba8b5c85eebeae7b71f9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b2989cc896ed49e1b77916b81efa8937', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e0d6749f534043693e20e84a1fb5aa397a82b1d92c747a8f3e0ec46a941fe31c1d5aa89d0cbcc1e0a629ed65dba397004f9333156f4291e8a8a6acb321ed174c', 'id': 'f7d47fdd-f496-4bcb-9172-8dd0f2c51750', 'created_at': datetime.datetime(2026, 9, 17, 13, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7d47fdd-f496-4bcb-9172-8dd0f2c51750/file', 'properties': {}}, 'image_service': } Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Trying to clone ea22992f-81d8-43db-817d-e7ec9f1d31d8 from image f7d47fdd-f496-4bcb-9172-8dd0f2c51750 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f7d47fdd-f496-4bcb-9172-8dd0f2c51750', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 15:13:07 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Image download 0.00 MB at 0.00 MB/s Sep 17 15:13:07 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-82dc8306-5b0b-4481-8523-cdcc4c8883b4" returned: 0 in 0.251s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "cinder-quobyte-82dc8306-5b0b-4481-8523-cdcc4c8883b4" released by "delete_volume" :: held 0.711s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f81dbd-dd6c-4db8-a7b2-ba19c1a7c7ef]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Created reservations ['a475915f-d325-4146-95ef-94c16a21c012', 'a2059448-a83b-41bb-ba3d-93fb2199d4cf', 'e9d085ae-ca77-412f-a774-905087527710', '95cfbdba-9d1e-47f7-8963-35cdc88dfc7f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:13:07 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD Sep 17 15:13:07 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:07 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:13:07 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:07 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD" returned: 0 in 0.375s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] Acquiring lock "cinder-d57843b1-ea82-48a3-b8bf-428a7803490c-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "cinder-d57843b1-ea82-48a3-b8bf-428a7803490c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] Acquiring lock "cinder-quobyte-d57843b1-ea82-48a3-b8bf-428a7803490c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:13:07 devstack sudo[104594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD Sep 17 15:13:07 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "cinder-quobyte-d57843b1-ea82-48a3-b8bf-428a7803490c" acquired by "delete_volume" :: waited 0.033s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:13:07 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.346s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:13:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Deleted volume successfully. Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a3e1f0-e3fb-4127-9e20-6fbc543a7184]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d57843b1-ea82-48a3-b8bf-428a7803490c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3233a28c-ec8b-475a-bc8a-4b34887e1b0b tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "cinder-82dc8306-5b0b-4481-8523-cdcc4c8883b4-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:13:07 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d57843b1-ea82-48a3-b8bf-428a7803490c Sep 17 15:13:07 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:07 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD" returned: 1 in 0.348s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:13:07 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Temporary image f7d47fdd-f496-4bcb-9172-8dd0f2c51750 is fetched for user a03366291be24ae294f6d686f6c4b686. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d29b15-56fb-453d-ac5c-bc7b5d19dde4]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:08 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD Sep 17 15:13:08 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:08 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d57843b1-ea82-48a3-b8bf-428a7803490c" returned: 0 in 0.367s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d57843b1-ea82-48a3-b8bf-428a7803490c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:08 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d57843b1-ea82-48a3-b8bf-428a7803490c Sep 17 15:13:08 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:08 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD" returned: 0 in 0.344s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:08 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d57843b1-ea82-48a3-b8bf-428a7803490c" returned: 0 in 0.263s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "cinder-quobyte-d57843b1-ea82-48a3-b8bf-428a7803490c" released by "delete_volume" :: held 0.692s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:13:08 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD Sep 17 15:13:08 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] Created reservations ['ca4789d0-5fa6-4ca5-997e-d118f5036853', '2bdb9cbe-071a-49a7-aa83-aade53591c2b', '64abf9e8-0541-42e0-a34f-93c8b42a2070', 'e54660c9-673e-4dc6-b8be-7f3a81cecc73'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:08 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:13:08 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:08 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD" returned: 1 in 0.332s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea22992f-81d8-43db-817d-e7ec9f1d31d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2989cc896ed49e1b77916b81efa8937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:13:07Z,use_quota=True,user_id='a03366291be24ae294f6d686f6c4b686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Creating volume ea22992f-81d8-43db-817d-e7ec9f1d31d8 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:13:08 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:08 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8 1073741824 Sep 17 15:13:08 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:08 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.274s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:13:08 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] Deleted volume successfully. Sep 17 15:13:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-55098c0c-b068-4f82-99a0-e911797b90dd tempest-TestServerVolumeAttachmentScenario-1395324093 None] Lock "cinder-d57843b1-ea82-48a3-b8bf-428a7803490c-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:13:09 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8 1073741824" returned: 0 in 0.458s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:09 devstack sudo[104627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8 Sep 17 15:13:09 devstack sudo[104627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:09 devstack sudo[104627]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:13:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:09 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Attempting download of f7d47fdd-f496-4bcb-9172-8dd0f2c51750 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7d47fdd-f496-4bcb-9172-8dd0f2c51750', 'metadata': {}}])) to volume ea22992f-81d8-43db-817d-e7ec9f1d31d8. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:13:09 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7391eefc-1e38-4451-94a6-172a4a25fbc7]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:13:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_spl9gr6k {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:09 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_spl9gr6k Sep 17 15:13:09 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:09 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_spl9gr6k" returned: 0 in 0.332s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_spl9gr6k {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:10 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_spl9gr6k Sep 17 15:13:10 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:10 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_spl9gr6k" returned: 1 in 0.341s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_spl9gr6k' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:13:10 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[003a510a-893f-4ea7-bb21-6f8efee17f39]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:13:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:10 devstack sudo[104640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD Sep 17 15:13:10 devstack sudo[104640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:10 devstack sudo[104640]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:10 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD Sep 17 15:13:10 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:10 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD" returned: 1 in 0.332s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:13:10 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] f7d47fdd-f496-4bcb-9172-8dd0f2c51750 was raw, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 15:13:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:10 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8 Sep 17 15:13:10 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:11 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8" returned: 0 in 0.487s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:11 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f7d47fdd-f496-4bcb-9172-8dd0f2c51750_r0t9iva3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:13:11 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 15:13:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:11 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8 1G Sep 17 15:13:11 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:11 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8 1G" returned: 0 in 0.301s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:11 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Downloaded image f7d47fdd-f496-4bcb-9172-8dd0f2c51750 ((None, [{'url': 'file:///opt/stack/data/glance/images/f7d47fdd-f496-4bcb-9172-8dd0f2c51750', 'metadata': {}}])) to volume ea22992f-81d8-43db-817d-e7ec9f1d31d8 successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:13:11 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Temporary image f7d47fdd-f496-4bcb-9172-8dd0f2c51750 for user a03366291be24ae294f6d686f6c4b686 is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 15:13:11 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Marking volume ea22992f-81d8-43db-817d-e7ec9f1d31d8 as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:13:11 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Copying metadata from image f7d47fdd-f496-4bcb-9172-8dd0f2c51750 to ea22992f-81d8-43db-817d-e7ec9f1d31d8. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:13:11 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Creating volume glance metadata for volume ea22992f-81d8-43db-817d-e7ec9f1d31d8 backed by image f7d47fdd-f496-4bcb-9172-8dd0f2c51750 with: {'image_id': 'f7d47fdd-f496-4bcb-9172-8dd0f2c51750', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b6bbc2166efdba8b5c85eebeae7b71f9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:13:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2631276f-5880-4f2f-a131-b6cbf2eacf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8', 'volume_size': 1, 'image_id': 'f7d47fdd-f496-4bcb-9172-8dd0f2c51750', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f7d47fdd-f496-4bcb-9172-8dd0f2c51750', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b6bbc2166efdba8b5c85eebeae7b71f9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b2989cc896ed49e1b77916b81efa8937', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e0d6749f534043693e20e84a1fb5aa397a82b1d92c747a8f3e0ec46a941fe31c1d5aa89d0cbcc1e0a629ed65dba397004f9333156f4291e8a8a6acb321ed174c', 'id': 'f7d47fdd-f496-4bcb-9172-8dd0f2c51750', 'created_at': datetime.datetime(2026, 9, 17, 13, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f7d47fdd-f496-4bcb-9172-8dd0f2c51750/file', 'properties': {}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7f6efa-3664-47c2-88fd-a87a5669acb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:11 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Volume volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8 (ea22992f-81d8-43db-817d-e7ec9f1d31d8): created successfully Sep 17 15:13:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7f6efa-3664-47c2-88fd-a87a5669acb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Flow 'volume_create_manager' (37430dc0-4b52-4d03-8965-86668f1a9d25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:13:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c2606c64-5ebf-4215-9609-be97e4d1d185 tempest-VolumeImageDependencyTests-1584872835 None] Created volume successfully. Sep 17 15:13:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] Acquiring lock "cinder-ea22992f-81d8-43db-817d-e7ec9f1d31d8-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:13:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] Lock "cinder-ea22992f-81d8-43db-817d-e7ec9f1d31d8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:13:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] Acquiring lock "cinder-quobyte-ea22992f-81d8-43db-817d-e7ec9f1d31d8" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:13:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] Lock "cinder-quobyte-ea22992f-81d8-43db-817d-e7ec9f1d31d8" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:13:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b930a211-af9c-48ff-86c4-77017b7b1ee3]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:13:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:12 devstack sudo[104659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8 Sep 17 15:13:12 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:12 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8" returned: 0 in 0.393s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:12 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8 Sep 17 15:13:12 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:13 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ea22992f-81d8-43db-817d-e7ec9f1d31d8" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] Lock "cinder-quobyte-ea22992f-81d8-43db-817d-e7ec9f1d31d8" released by "delete_volume" :: held 0.708s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:13:13 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] Created reservations ['7eecd042-ebea-4896-8f73-25797705a24b', '89fde061-acfb-487b-93de-5cd2a1cbc470', 'ce1bcd93-e134-45ce-a83a-c145ffb67935', '38c2157f-5da8-45f8-9263-a0406018b6e7'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:13:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:13:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:13:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:13 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:13:13 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:13 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.287s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:13 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:13:13 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] Deleted volume successfully. Sep 17 15:13:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5fb647f0-94ff-4741-b850-3a6770ffed87 tempest-VolumeImageDependencyTests-1584872835 None] Lock "cinder-ea22992f-81d8-43db-817d-e7ec9f1d31d8-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:13:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-9145718c-563b-431b-b99e-afe0980906dd req-258aa28d-bba6-4f61-ad26-1d47911c2b39 tempest-TestShelveInstance-61082965 None] Terminate volume connection completed successfully. Sep 17 15:13:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-9145718c-563b-431b-b99e-afe0980906dd req-258aa28d-bba6-4f61-ad26-1d47911c2b39 tempest-TestShelveInstance-61082965 None] Deleting attachment 042f7a27-a31b-4319-a1a4-64d7c651fd9e. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:13:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] Acquiring lock "cinder-bae1d3fa-6b7f-4f50-917a-f1753809be78-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:13:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] Lock "cinder-bae1d3fa-6b7f-4f50-917a-f1753809be78-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:13:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] Acquiring lock "cinder-quobyte-bae1d3fa-6b7f-4f50-917a-f1753809be78" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:13:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] Lock "cinder-quobyte-bae1d3fa-6b7f-4f50-917a-f1753809be78" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:13:18 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f358a164-3d4b-48ab-8c8d-701b0f8f7d59]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:13:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:18 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78 Sep 17 15:13:18 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:18 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78" returned: 0 in 0.437s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:18 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78 Sep 17 15:13:18 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:19 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bae1d3fa-6b7f-4f50-917a-f1753809be78" returned: 0 in 0.265s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] Lock "cinder-quobyte-bae1d3fa-6b7f-4f50-917a-f1753809be78" released by "delete_volume" :: held 0.764s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:13:19 devstack cinder-volume[86082]: DEBUG cinder.quota [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] Created reservations ['7e8cac1a-756b-4db9-8fcc-b2adf276eb34', '06b2d99b-0de9-49d4-8109-ffbd7400c08d', 'f6ebd4b5-5763-4f24-ac49-da208e7e22af', '04ded954-950e-42ec-8659-c3aaa6bdce10'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:13:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:13:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:13:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:19 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:13:19 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:19 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.274s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:19 devstack cinder-volume[86082]: DEBUG cinder.manager [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:13:19 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] Deleted volume successfully. Sep 17 15:13:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-9145718c-563b-431b-b99e-afe0980906dd req-eaea5059-fed1-4b03-91a9-795d245fd74a tempest-TestShelveInstance-61082965 None] Lock "cinder-bae1d3fa-6b7f-4f50-917a-f1753809be78-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Flow 'volume_create_manager' (3402e0a4-ab2e-4abb-be61-4c9b8738eed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e2a4bf-89f8-4b89-90be-1d9082c2065e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e2a4bf-89f8-4b89-90be-1d9082c2065e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1715223973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5f291f-cd8f-40f2-968c-32dc39113d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e799e3f9ed94699b8c2a0803db8e00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:13:22Z,use_quota=True,user_id='9c5e686c6bde4854948a6d2a27c4f573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b18f7b8-9d9b-4056-a213-574d0c5fd9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b18f7b8-9d9b-4056-a213-574d0c5fd9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5fc754-0d08-4c4a-a2a5-df7f0b053d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5fc754-0d08-4c4a-a2a5-df7f0b053d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c5f291f-cd8f-40f2-968c-32dc39113d28', 'volume_name': 'volume-5c5f291f-cd8f-40f2-968c-32dc39113d28', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce62803a-4aa7-47c6-aeed-2358ae8c11ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce62803a-4aa7-47c6-aeed-2358ae8c11ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8bc8177-a302-429e-8837-5ea80ff230bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:22 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Volume 5c5f291f-cd8f-40f2-968c-32dc39113d28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c5f291f-cd8f-40f2-968c-32dc39113d28', 'volume_size': 1} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1715223973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5f291f-cd8f-40f2-968c-32dc39113d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e799e3f9ed94699b8c2a0803db8e00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:13:22Z,use_quota=True,user_id='9c5e686c6bde4854948a6d2a27c4f573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Creating volume 5c5f291f-cd8f-40f2-968c-32dc39113d28 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:13:22 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5c5f291f-cd8f-40f2-968c-32dc39113d28 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:22 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5c5f291f-cd8f-40f2-968c-32dc39113d28 1073741824 Sep 17 15:13:22 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:22 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5c5f291f-cd8f-40f2-968c-32dc39113d28 1073741824" returned: 0 in 0.473s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5c5f291f-cd8f-40f2-968c-32dc39113d28 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:22 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5c5f291f-cd8f-40f2-968c-32dc39113d28 Sep 17 15:13:22 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:23 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5c5f291f-cd8f-40f2-968c-32dc39113d28" returned: 0 in 0.251s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:13:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8bc8177-a302-429e-8837-5ea80ff230bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c5f291f-cd8f-40f2-968c-32dc39113d28', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9b49ea-3427-4b09-ad5c-8168738ed859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:23 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Volume volume-5c5f291f-cd8f-40f2-968c-32dc39113d28 (5c5f291f-cd8f-40f2-968c-32dc39113d28): created successfully Sep 17 15:13:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9b49ea-3427-4b09-ad5c-8168738ed859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Flow 'volume_create_manager' (3402e0a4-ab2e-4abb-be61-4c9b8738eed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:13:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fd6cb614-33dd-4275-a447-b47ba9e1795d tempest-ProjectReaderTests-308187097 None] Created volume successfully. Sep 17 15:13:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] Acquiring lock "cinder-5c5f291f-cd8f-40f2-968c-32dc39113d28-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:13:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] Lock "cinder-5c5f291f-cd8f-40f2-968c-32dc39113d28-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:13:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] Acquiring lock "cinder-quobyte-5c5f291f-cd8f-40f2-968c-32dc39113d28" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:13:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] Lock "cinder-quobyte-5c5f291f-cd8f-40f2-968c-32dc39113d28" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:13:24 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef61ea4-a648-47df-b5fd-668aade29904]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:13:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5c5f291f-cd8f-40f2-968c-32dc39113d28 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:24 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5c5f291f-cd8f-40f2-968c-32dc39113d28 Sep 17 15:13:24 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:25 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5c5f291f-cd8f-40f2-968c-32dc39113d28" returned: 0 in 0.373s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5c5f291f-cd8f-40f2-968c-32dc39113d28 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:25 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5c5f291f-cd8f-40f2-968c-32dc39113d28 Sep 17 15:13:25 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:25 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5c5f291f-cd8f-40f2-968c-32dc39113d28" returned: 0 in 0.258s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] Lock "cinder-quobyte-5c5f291f-cd8f-40f2-968c-32dc39113d28" released by "delete_volume" :: held 0.692s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:13:25 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] Created reservations ['49641c88-8980-4f87-a7db-0831aadf606b', 'a3dede86-eebe-4dbf-90e0-3579e79ff4a0', '4366bbee-8b43-40f7-8858-8ca68cffc343', '8a2d2511-8efb-4072-880d-50099fed8f2e'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:13:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:13:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:13:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:25 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:13:25 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:25 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.265s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:25 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:13:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] Deleted volume successfully. Sep 17 15:13:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2aaba6a7-2841-4de1-8846-1a3457f9303d tempest-ProjectReaderTests-308187097 None] Lock "cinder-5c5f291f-cd8f-40f2-968c-32dc39113d28-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Flow 'volume_create_manager' (f51a1827-ec82-4777-8838-4458505550f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75582df-dbf0-4a62-99ad-fef14ee5ed56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75582df-dbf0-4a62-99ad-fef14ee5ed56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1640668962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e799e3f9ed94699b8c2a0803db8e00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:13:26Z,use_quota=True,user_id='9c5e686c6bde4854948a6d2a27c4f573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6c42fd-415f-4405-9479-749a34c2712c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a6c42fd-415f-4405-9479-749a34c2712c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a619f0-dc94-4c2e-966d-4344a5e1e394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a619f0-dc94-4c2e-966d-4344a5e1e394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb', 'volume_name': 'volume-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caa2c095-7ad9-441c-8996-5f47aa177f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caa2c095-7ad9-441c-8996-5f47aa177f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f403f3-4256-4152-8ec5-981880b00922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:26 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Volume bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb', 'volume_size': 1} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1640668962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e799e3f9ed94699b8c2a0803db8e00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:13:26Z,use_quota=True,user_id='9c5e686c6bde4854948a6d2a27c4f573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Creating volume bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:13:26 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:26 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb 1073741824 Sep 17 15:13:26 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:26 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb 1073741824" returned: 0 in 0.454s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:26 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb Sep 17 15:13:26 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:27 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb" returned: 0 in 0.269s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:13:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08f403f3-4256-4152-8ec5-981880b00922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3bc43e5-30b8-4e3c-848f-acee67796590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:27 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Volume volume-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb (bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb): created successfully Sep 17 15:13:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3bc43e5-30b8-4e3c-848f-acee67796590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Flow 'volume_create_manager' (f51a1827-ec82-4777-8838-4458505550f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:13:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-410e2ed4-ad4a-4924-87e7-d3986ad061e0 tempest-ProjectReaderTests-308187097 None] Created volume successfully. Sep 17 15:13:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] Acquiring lock "cinder-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:13:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] Lock "cinder-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:13:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] Acquiring lock "cinder-quobyte-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:13:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] Lock "cinder-quobyte-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:13:28 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbf01c5-b4b4-4992-bb80-790c44910f1c]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:13:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:28 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb Sep 17 15:13:28 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:28 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb" returned: 0 in 0.390s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:28 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb Sep 17 15:13:28 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:29 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb" returned: 0 in 0.288s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] Lock "cinder-quobyte-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb" released by "delete_volume" :: held 0.721s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:13:29 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] Created reservations ['79cf4bd5-340e-4f96-8168-c7f094bc49e3', '6ca85558-7f89-4a9d-be53-f3022817a5f5', 'b33b9304-ec64-45f7-a7b1-3f93d7f9e1d0', '4bc29ad4-2b76-4e7e-bf65-3322cd945434'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:13:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:13:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:13:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:29 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:13:29 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:29 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.279s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:29 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:13:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] Deleted volume successfully. Sep 17 15:13:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f168851a-dd51-444d-985a-780bacea100f tempest-ProjectReaderTests-308187097 None] Lock "cinder-bcbdd74a-39ae-46aa-93f5-ffb0d7fcefbb-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:13:39 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=43,cinder:INSERT=15,cinder:UPDATE=52,cinder:DELETE=4 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:13:39 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=39,cinder:INSERT=21,cinder:UPDATE=63,cinder:DELETE=5 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:13:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:13:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:13:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:13:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:40 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:13:40 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:40 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:13:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:13:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:13:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Flow 'volume_create_manager' (e4c5ea20-fb0d-4368-9aa7-540d67165af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c75ed9-d1ed-4e1b-a7af-d76aeb50286e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c75ed9-d1ed-4e1b-a7af-d76aeb50286e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1331151928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99bae11-0b06-436b-b065-03477a977983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f0e25d3530741ba906d4c7297170f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:13:51Z,use_quota=True,user_id='51dd54b016fc4b939581e79315665667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f79e8e-3879-49fd-bc81-f78aba248326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f79e8e-3879-49fd-bc81-f78aba248326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df46c2ee-2944-44a3-95cc-de42621a4723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df46c2ee-2944-44a3-95cc-de42621a4723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c99bae11-0b06-436b-b065-03477a977983', 'volume_name': 'volume-c99bae11-0b06-436b-b065-03477a977983', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65869b8d-e8cf-4f8e-976b-6d833d70678b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65869b8d-e8cf-4f8e-976b-6d833d70678b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8df4749-9094-463e-9753-357108196e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Volume c99bae11-0b06-436b-b065-03477a977983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c99bae11-0b06-436b-b065-03477a977983', 'volume_size': 1} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1331151928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c99bae11-0b06-436b-b065-03477a977983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f0e25d3530741ba906d4c7297170f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:13:51Z,use_quota=True,user_id='51dd54b016fc4b939581e79315665667',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Creating volume c99bae11-0b06-436b-b065-03477a977983 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:13:51 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:51 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983 1073741824 Sep 17 15:13:51 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:51 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983 1073741824" returned: 0 in 0.402s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:51 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983 Sep 17 15:13:51 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:51 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983" returned: 0 in 0.236s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8df4749-9094-463e-9753-357108196e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c99bae11-0b06-436b-b065-03477a977983', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e864f3-28e4-4ecd-ac50-4d3434f57ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Volume volume-c99bae11-0b06-436b-b065-03477a977983 (c99bae11-0b06-436b-b065-03477a977983): created successfully Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4e864f3-28e4-4ecd-ac50-4d3434f57ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Flow 'volume_create_manager' (e4c5ea20-fb0d-4368-9aa7-540d67165af4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:13:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-876f2a7e-6254-4408-8414-751bd4bf7698 tempest-TestImageHashVerification-1631533448 None] Created volume successfully. Sep 17 15:13:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ab9c8312-d788-4ac4-a9aa-f2be52fbf0b1 tempest-TestImageHashVerification-1631533448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ab9c8312-d788-4ac4-a9aa-f2be52fbf0b1 tempest-TestImageHashVerification-1631533448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:52 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ce49c8-86a9-4903-bff2-ab75512d2782]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:13:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ab9c8312-d788-4ac4-a9aa-f2be52fbf0b1 tempest-TestImageHashVerification-1631533448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:52 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983 Sep 17 15:13:52 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:53 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ab9c8312-d788-4ac4-a9aa-f2be52fbf0b1 tempest-TestImageHashVerification-1631533448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983" returned: 0 in 0.361s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:53 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f389c723-7b34-43f2-a240-eb6a9f5a81a5]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:13:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ab9c8312-d788-4ac4-a9aa-f2be52fbf0b1 tempest-TestImageHashVerification-1631533448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:53 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983 Sep 17 15:13:53 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:53 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ab9c8312-d788-4ac4-a9aa-f2be52fbf0b1 tempest-TestImageHashVerification-1631533448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983" returned: 0 in 0.357s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ab9c8312-d788-4ac4-a9aa-f2be52fbf0b1 tempest-TestImageHashVerification-1631533448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983 /opt/stack/data/cinder/conversion/c99bae11-0b06-436b-b065-03477a977983.temp_image.46f248b7-fc5d-40bb-84a5-cb50c69fd1c36j6id3w8.img {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:53 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983 /opt/stack/data/cinder/conversion/c99bae11-0b06-436b-b065-03477a977983.temp_image.46f248b7-fc5d-40bb-84a5-cb50c69fd1c36j6id3w8.img Sep 17 15:13:53 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:59 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ab9c8312-d788-4ac4-a9aa-f2be52fbf0b1 tempest-TestImageHashVerification-1631533448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983 /opt/stack/data/cinder/conversion/c99bae11-0b06-436b-b065-03477a977983.temp_image.46f248b7-fc5d-40bb-84a5-cb50c69fd1c36j6id3w8.img" returned: 0 in 5.754s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:59 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e746e5dc-fd88-4093-b04b-306f65ed23f8]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:13:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ab9c8312-d788-4ac4-a9aa-f2be52fbf0b1 tempest-TestImageHashVerification-1631533448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:59 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983 Sep 17 15:13:59 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:59 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ab9c8312-d788-4ac4-a9aa-f2be52fbf0b1 tempest-TestImageHashVerification-1631533448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983" returned: 0 in 0.517s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:59 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-ab9c8312-d788-4ac4-a9aa-f2be52fbf0b1 tempest-TestImageHashVerification-1631533448 None] Image conversion details: src /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983, size 1024.00 MB, duration 5.75 sec, destination /opt/stack/data/cinder/conversion/c99bae11-0b06-436b-b065-03477a977983.temp_image.46f248b7-fc5d-40bb-84a5-cb50c69fd1c36j6id3w8.img {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:13:59 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-ab9c8312-d788-4ac4-a9aa-f2be52fbf0b1 tempest-TestImageHashVerification-1631533448 None] Converted 1024.00 MB image at 177.93 MB/s Sep 17 15:13:59 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-ab9c8312-d788-4ac4-a9aa-f2be52fbf0b1 tempest-TestImageHashVerification-1631533448 None] 46f248b7-fc5d-40bb-84a5-cb50c69fd1c3 was raw, no need to convert to raw {{(pid=86082) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 17 15:14:09 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:14:09 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:14:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ab9c8312-d788-4ac4-a9aa-f2be52fbf0b1 tempest-TestImageHashVerification-1631533448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.723s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ab9c8312-d788-4ac4-a9aa-f2be52fbf0b1 tempest-TestImageHashVerification-1631533448 None] Uploaded volume to glance image-id: 46f248b7-fc5d-40bb-84a5-cb50c69fd1c3. {{(pid=86082) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 17 15:14:17 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ab9c8312-d788-4ac4-a9aa-f2be52fbf0b1 tempest-TestImageHashVerification-1631533448 None] Copy volume to image completed successfully. Sep 17 15:14:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] Acquiring lock "cinder-c99bae11-0b06-436b-b065-03477a977983-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] Lock "cinder-c99bae11-0b06-436b-b065-03477a977983-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] Acquiring lock "cinder-quobyte-c99bae11-0b06-436b-b065-03477a977983" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] Lock "cinder-quobyte-c99bae11-0b06-436b-b065-03477a977983" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:18 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1c35ef-1344-4a9f-9bec-be2ee6be4a27]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:18 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983 Sep 17 15:14:18 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:18 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983" returned: 0 in 0.354s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:18 devstack sudo[104899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983 Sep 17 15:14:18 devstack sudo[104899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:18 devstack sudo[104899]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c99bae11-0b06-436b-b065-03477a977983" returned: 0 in 0.240s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] Lock "cinder-quobyte-c99bae11-0b06-436b-b065-03477a977983" released by "delete_volume" :: held 0.636s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:19 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] Created reservations ['0573715d-c7f4-490d-8b6c-2e92db25fcff', '0f2c384e-8e84-4027-bad3-5693f83550c1', 'a80da70f-55f1-4127-b213-902e7a6216e2', 'd9459e2a-1799-403d-a888-29f272e00830'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:19 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:14:19 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:19 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.235s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:19 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:19 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] Deleted volume successfully. Sep 17 15:14:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb95f6ad-cb77-4288-9365-39ae44182ffc tempest-TestImageHashVerification-1631533448 None] Lock "cinder-c99bae11-0b06-436b-b065-03477a977983-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:29 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:14:29 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Flow 'volume_create_manager' (5786b22c-c6b1-4b4e-bcfe-3f9f8ec77dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ef8393-8307-443d-b43f-071a7754f557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ef8393-8307-443d-b43f-071a7754f557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1828365265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2727f6-83c3-4911-ab67-54ec921a1268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a732d6842e8443e9a8b2bd291864d595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:30Z,use_quota=True,user_id='82eb8ec7996f4a6697a1899c09f7aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a0e591-421b-401f-81f1-56af5ed64524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a0e591-421b-401f-81f1-56af5ed64524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce2b4d9-588f-47ea-9c80-ff3268f38f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce2b4d9-588f-47ea-9c80-ff3268f38f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2727f6-83c3-4911-ab67-54ec921a1268', 'volume_name': 'volume-fb2727f6-83c3-4911-ab67-54ec921a1268', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63bf129b-bb38-4ef8-b107-af2051a282c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63bf129b-bb38-4ef8-b107-af2051a282c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6f7e58-dda7-471e-ba4b-767a4d3954f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:30 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Volume fb2727f6-83c3-4911-ab67-54ec921a1268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2727f6-83c3-4911-ab67-54ec921a1268', 'volume_size': 1} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1828365265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2727f6-83c3-4911-ab67-54ec921a1268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a732d6842e8443e9a8b2bd291864d595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:30Z,use_quota=True,user_id='82eb8ec7996f4a6697a1899c09f7aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Creating volume fb2727f6-83c3-4911-ab67-54ec921a1268 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:14:30 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:30 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268 1073741824 Sep 17 15:14:30 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:30 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268 1073741824" returned: 0 in 0.425s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:30 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268 Sep 17 15:14:30 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:30 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268" returned: 0 in 0.239s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:14:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6f7e58-dda7-471e-ba4b-767a4d3954f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2727f6-83c3-4911-ab67-54ec921a1268', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f170b165-11f0-43c8-b92f-e15267206b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:31 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Volume volume-fb2727f6-83c3-4911-ab67-54ec921a1268 (fb2727f6-83c3-4911-ab67-54ec921a1268): created successfully Sep 17 15:14:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f170b165-11f0-43c8-b92f-e15267206b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Flow 'volume_create_manager' (5786b22c-c6b1-4b4e-bcfe-3f9f8ec77dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1f343353-5cd6-410e-a950-ed1b3efd12e3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Created volume successfully. Sep 17 15:14:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] Creating offline snapshot b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c of volume fb2727f6-83c3-4911-ab67-54ec921a1268 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:14:31 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c64296d-1e36-430c-b867-dfbe5da0fd27]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:31 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268 Sep 17 15:14:31 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:31 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268" returned: 0 in 0.364s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:31 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c 1G Sep 17 15:14:31 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:32 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c 1G" returned: 0 in 0.379s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2727f6-83c3-4911-ab67-54ec921a1268 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:32 devstack sudo[104931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2727f6-83c3-4911-ab67-54ec921a1268 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c Sep 17 15:14:32 devstack sudo[104931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:32 devstack sudo[104931]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb2727f6-83c3-4911-ab67-54ec921a1268 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c" returned: 0 in 0.287s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:32 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c is being set with open permissions: ugo+rw Sep 17 15:14:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:32 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c Sep 17 15:14:32 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:32 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c" returned: 0 in 0.242s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:32 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.info Sep 17 15:14:32 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:32 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.info" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:32 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.info is being set with open permissions: ugo+rw Sep 17 15:14:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:32 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.info Sep 17 15:14:32 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:33 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.info" returned: 0 in 0.233s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9c19ada1-f2a1-4550-9548-22f826c5e006 tempest-CreateVolumesFromSnapshotTest-413359341 None] Create snapshot completed successfully Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Flow 'volume_create_manager' (7a893241-29cb-4833-9a80-38e9b9fd37be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e2076f-129f-4cde-8cda-65685ed131cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e2076f-129f-4cde-8cda-65685ed131cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1212130576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934f8f09-44e8-4a2b-a1d0-f81fb72c81b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a732d6842e8443e9a8b2bd291864d595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:34Z,use_quota=True,user_id='82eb8ec7996f4a6697a1899c09f7aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f51312-581e-46d4-9497-1b6b7105e47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f51312-581e-46d4-9497-1b6b7105e47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970ae847-a46b-449d-b752-44963f82dc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970ae847-a46b-449d-b752-44963f82dc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '934f8f09-44e8-4a2b-a1d0-f81fb72c81b9', 'volume_name': 'volume-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7d0a0f-c45d-45d6-8e48-c364c1cad42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7d0a0f-c45d-45d6-8e48-c364c1cad42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50d8a4e-b1bb-4906-b453-385d709d0d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:33 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Volume 934f8f09-44e8-4a2b-a1d0-f81fb72c81b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9', 'volume_size': 1} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1212130576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934f8f09-44e8-4a2b-a1d0-f81fb72c81b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a732d6842e8443e9a8b2bd291864d595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:34Z,use_quota=True,user_id='82eb8ec7996f4a6697a1899c09f7aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Creating volume 934f8f09-44e8-4a2b-a1d0-f81fb72c81b9 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:14:33 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:14:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:34 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9 1073741824 Sep 17 15:14:34 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Flow 'volume_create_manager' (ca223ae4-f050-4710-b739-51ab6ed30536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd05a04-8ca3-4233-981f-e4dbab44a182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd05a04-8ca3-4233-981f-e4dbab44a182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-412335416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0d406a-68d5-4a66-b8e7-3558b3852c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a732d6842e8443e9a8b2bd291864d595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:34Z,use_quota=True,user_id='82eb8ec7996f4a6697a1899c09f7aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f839db58-dc1e-40b8-9b81-d63dd7c82630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f839db58-dc1e-40b8-9b81-d63dd7c82630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476b856d-0f47-4b57-b54b-5cf9071a9583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476b856d-0f47-4b57-b54b-5cf9071a9583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c0d406a-68d5-4a66-b8e7-3558b3852c25', 'volume_name': 'volume-0c0d406a-68d5-4a66-b8e7-3558b3852c25', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60e8d11-5540-47a7-a31e-4eb371ed3594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60e8d11-5540-47a7-a31e-4eb371ed3594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748a55eb-3243-45a7-99f6-a9e70edd14e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:34 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Volume 0c0d406a-68d5-4a66-b8e7-3558b3852c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c0d406a-68d5-4a66-b8e7-3558b3852c25', 'volume_size': 1} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:34 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9 1073741824" returned: 0 in 0.493s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:34 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9 Sep 17 15:14:34 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Flow 'volume_create_manager' (ec9c3c0e-7f1c-4dad-ab18-782fb8ec48ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8acdc07-d5c6-4895-92fc-b31b98de8c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8acdc07-d5c6-4895-92fc-b31b98de8c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-372067830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ef4486-b8d0-498d-a069-d515cb327f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a732d6842e8443e9a8b2bd291864d595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:35Z,use_quota=True,user_id='82eb8ec7996f4a6697a1899c09f7aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa9c810-9b69-4e64-ad8b-737cff5e7d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa9c810-9b69-4e64-ad8b-737cff5e7d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab1ddee-7d59-4c39-b056-fcfdcd607408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ab1ddee-7d59-4c39-b056-fcfdcd607408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28ef4486-b8d0-498d-a069-d515cb327f7d', 'volume_name': 'volume-28ef4486-b8d0-498d-a069-d515cb327f7d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ff5188-8393-4194-9a8a-e1cc270784fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ff5188-8393-4194-9a8a-e1cc270784fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76fb6b26-25e9-4525-9ff4-88860ffec789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:34 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Volume 28ef4486-b8d0-498d-a069-d515cb327f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28ef4486-b8d0-498d-a069-d515cb327f7d', 'volume_size': 1} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:34 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9" returned: 0 in 0.280s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.452s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-412335416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0d406a-68d5-4a66-b8e7-3558b3852c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a732d6842e8443e9a8b2bd291864d595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:34Z,use_quota=True,user_id='82eb8ec7996f4a6697a1899c09f7aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Creating volume 0c0d406a-68d5-4a66-b8e7-3558b3852c25 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:14:34 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0c0d406a-68d5-4a66-b8e7-3558b3852c25 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d50d8a4e-b1bb-4906-b453-385d709d0d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:34 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0c0d406a-68d5-4a66-b8e7-3558b3852c25 1073741824 Sep 17 15:14:34 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d9d9e0-7a0d-4357-a448-ea8c5fc8b582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:34 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Volume volume-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9 (934f8f09-44e8-4a2b-a1d0-f81fb72c81b9): created successfully Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d9d9e0-7a0d-4357-a448-ea8c5fc8b582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Flow 'volume_create_manager' (7a893241-29cb-4833-9a80-38e9b9fd37be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:34 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4366d306-af63-4be3-8c85-8d518843b50c tempest-CreateVolumesFromSnapshotTest-413359341 None] Created volume successfully. Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:14:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Flow 'volume_create_manager' (393a2991-9a24-43b5-8366-da4e6fcf8390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8318ee9-b283-4baf-9e18-f1ab7c5251da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8318ee9-b283-4baf-9e18-f1ab7c5251da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-259188306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d44a9d-e998-4c6a-b3c1-bbce816bc7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a732d6842e8443e9a8b2bd291864d595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:35Z,use_quota=True,user_id='82eb8ec7996f4a6697a1899c09f7aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8f8613-ae7a-4c26-b198-f9a6d33fe4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8f8613-ae7a-4c26-b198-f9a6d33fe4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e55fe56-ac7b-4e4d-8f65-978cf220747c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e55fe56-ac7b-4e4d-8f65-978cf220747c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56d44a9d-e998-4c6a-b3c1-bbce816bc7ab', 'volume_name': 'volume-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc79f10-8da1-40b6-8d15-9b5cc87ec98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc79f10-8da1-40b6-8d15-9b5cc87ec98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3978602d-5c42-4d62-9891-14c19a50e8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:35 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Volume 56d44a9d-e998-4c6a-b3c1-bbce816bc7ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab', 'volume_size': 1} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:35 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0c0d406a-68d5-4a66-b8e7-3558b3852c25 1073741824" returned: 0 in 0.528s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Flow 'volume_create_manager' (2452318c-b25d-4a98-87d2-fc942e32a1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78fd6bef-21a1-47c7-a195-e5ac63695c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78fd6bef-21a1-47c7-a195-e5ac63695c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-80844356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56632bb7-d7ca-4d59-a85a-70373cf98ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a732d6842e8443e9a8b2bd291864d595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:35Z,use_quota=True,user_id='82eb8ec7996f4a6697a1899c09f7aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c88393-74cd-4662-8f35-80490b6c2230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c88393-74cd-4662-8f35-80490b6c2230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce69f48d-1f2b-441c-8494-7d7cdef2fdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce69f48d-1f2b-441c-8494-7d7cdef2fdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56632bb7-d7ca-4d59-a85a-70373cf98ddd', 'volume_name': 'volume-56632bb7-d7ca-4d59-a85a-70373cf98ddd', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea82b163-89de-4667-a2fc-30597507f469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea82b163-89de-4667-a2fc-30597507f469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607d5515-3cba-4889-b593-02d43fa24975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:35 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Volume 56632bb7-d7ca-4d59-a85a-70373cf98ddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56632bb7-d7ca-4d59-a85a-70373cf98ddd', 'volume_size': 1} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0c0d406a-68d5-4a66-b8e7-3558b3852c25 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:35 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0c0d406a-68d5-4a66-b8e7-3558b3852c25 Sep 17 15:14:35 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:35 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0c0d406a-68d5-4a66-b8e7-3558b3852c25" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.978s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-372067830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ef4486-b8d0-498d-a069-d515cb327f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a732d6842e8443e9a8b2bd291864d595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:35Z,use_quota=True,user_id='82eb8ec7996f4a6697a1899c09f7aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Creating volume 28ef4486-b8d0-498d-a069-d515cb327f7d {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:14:35 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-28ef4486-b8d0-498d-a069-d515cb327f7d 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:35 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-28ef4486-b8d0-498d-a069-d515cb327f7d 1073741824 Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748a55eb-3243-45a7-99f6-a9e70edd14e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c0d406a-68d5-4a66-b8e7-3558b3852c25', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:35 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9384e8e9-a6f2-4947-a2ab-ecef565f4a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:35 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Volume volume-0c0d406a-68d5-4a66-b8e7-3558b3852c25 (0c0d406a-68d5-4a66-b8e7-3558b3852c25): created successfully Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9384e8e9-a6f2-4947-a2ab-ecef565f4a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Flow 'volume_create_manager' (ca223ae4-f050-4710-b739-51ab6ed30536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:35 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f9a7073e-f562-450c-a518-9ae71e2c8450 tempest-CreateVolumesFromSnapshotTest-413359341 None] Created volume successfully. Sep 17 15:14:36 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-28ef4486-b8d0-498d-a069-d515cb327f7d 1073741824" returned: 0 in 0.417s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-28ef4486-b8d0-498d-a069-d515cb327f7d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:36 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-28ef4486-b8d0-498d-a069-d515cb327f7d Sep 17 15:14:36 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:36 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-28ef4486-b8d0-498d-a069-d515cb327f7d" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.338s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-259188306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d44a9d-e998-4c6a-b3c1-bbce816bc7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a732d6842e8443e9a8b2bd291864d595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:35Z,use_quota=True,user_id='82eb8ec7996f4a6697a1899c09f7aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Creating volume 56d44a9d-e998-4c6a-b3c1-bbce816bc7ab {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:14:36 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76fb6b26-25e9-4525-9ff4-88860ffec789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28ef4486-b8d0-498d-a069-d515cb327f7d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:36 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab 1073741824 Sep 17 15:14:36 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0776e8-62ec-4af2-bcad-e1d7fa20b43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:36 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Volume volume-28ef4486-b8d0-498d-a069-d515cb327f7d (28ef4486-b8d0-498d-a069-d515cb327f7d): created successfully Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb0776e8-62ec-4af2-bcad-e1d7fa20b43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Flow 'volume_create_manager' (ec9c3c0e-7f1c-4dad-ab18-782fb8ec48ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:36 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-98fa4d5b-8093-4bf6-a07e-cdd0a4eea59b tempest-CreateVolumesFromSnapshotTest-413359341 None] Created volume successfully. Sep 17 15:14:36 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab 1073741824" returned: 0 in 0.429s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:36 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab Sep 17 15:14:36 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:37 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab" returned: 0 in 0.245s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.700s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-80844356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56632bb7-d7ca-4d59-a85a-70373cf98ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a732d6842e8443e9a8b2bd291864d595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:35Z,use_quota=True,user_id='82eb8ec7996f4a6697a1899c09f7aeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Creating volume 56632bb7-d7ca-4d59-a85a-70373cf98ddd {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:14:37 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56632bb7-d7ca-4d59-a85a-70373cf98ddd 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3978602d-5c42-4d62-9891-14c19a50e8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:37 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56632bb7-d7ca-4d59-a85a-70373cf98ddd 1073741824 Sep 17 15:14:37 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6eff17e-d1c3-4403-957c-18537df937d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:37 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Volume volume-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab (56d44a9d-e998-4c6a-b3c1-bbce816bc7ab): created successfully Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6eff17e-d1c3-4403-957c-18537df937d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Flow 'volume_create_manager' (393a2991-9a24-43b5-8366-da4e6fcf8390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c91b2424-81eb-49f7-b768-a333a65f1252 tempest-CreateVolumesFromSnapshotTest-413359341 None] Created volume successfully. Sep 17 15:14:37 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56632bb7-d7ca-4d59-a85a-70373cf98ddd 1073741824" returned: 0 in 0.431s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56632bb7-d7ca-4d59-a85a-70373cf98ddd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:37 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56632bb7-d7ca-4d59-a85a-70373cf98ddd Sep 17 15:14:37 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:37 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56632bb7-d7ca-4d59-a85a-70373cf98ddd" returned: 0 in 0.245s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607d5515-3cba-4889-b593-02d43fa24975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56632bb7-d7ca-4d59-a85a-70373cf98ddd', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e456af0-cbfa-42c1-a75d-434b4491387b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:37 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Volume volume-56632bb7-d7ca-4d59-a85a-70373cf98ddd (56632bb7-d7ca-4d59-a85a-70373cf98ddd): created successfully Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e456af0-cbfa-42c1-a75d-434b4491387b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Flow 'volume_create_manager' (2452318c-b25d-4a98-87d2-fc942e32a1b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7c1a1a7d-5e05-40ca-8cb0-0b133756dae0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Created volume successfully. Sep 17 15:14:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "cinder-56632bb7-d7ca-4d59-a85a-70373cf98ddd-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-56632bb7-d7ca-4d59-a85a-70373cf98ddd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "cinder-quobyte-56632bb7-d7ca-4d59-a85a-70373cf98ddd" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-quobyte-56632bb7-d7ca-4d59-a85a-70373cf98ddd" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:38 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa269ceb-991a-431c-b6a0-be567dc0562d]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56632bb7-d7ca-4d59-a85a-70373cf98ddd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:38 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56632bb7-d7ca-4d59-a85a-70373cf98ddd Sep 17 15:14:38 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:39 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56632bb7-d7ca-4d59-a85a-70373cf98ddd" returned: 0 in 0.346s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56632bb7-d7ca-4d59-a85a-70373cf98ddd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:39 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56632bb7-d7ca-4d59-a85a-70373cf98ddd Sep 17 15:14:39 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:39 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56632bb7-d7ca-4d59-a85a-70373cf98ddd" returned: 0 in 0.249s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-quobyte-56632bb7-d7ca-4d59-a85a-70373cf98ddd" released by "delete_volume" :: held 0.633s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Created reservations ['4991ebca-d29f-48a7-a4b3-ff3b7689d5a4', 'ad4b3d86-1b56-4fc7-89a5-ee2194b7eae6', 'a67faccc-0e98-42b9-9938-6d9cf54b82b0', '4e533fc5-1d54-4e1c-8926-d4328b408dbe'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:39 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:14:39 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:39 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.245s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:39 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Deleted volume successfully. Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0b8d6161-49c7-41fa-b3ae-a19cc1a3a4e0 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-56632bb7-d7ca-4d59-a85a-70373cf98ddd-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "cinder-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "cinder-quobyte-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-quobyte-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab" acquired by "delete_volume" :: waited 0.012s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa7c2f4-89d7-4db9-885f-0006536117d1]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:40 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab Sep 17 15:14:40 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:40 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab" returned: 0 in 0.349s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:40 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab Sep 17 15:14:40 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:40 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:14:40 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:40 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab" returned: 0 in 0.254s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-quobyte-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab" released by "delete_volume" :: held 0.647s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:40 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.252s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] Created reservations ['f1310215-eef2-4d0d-94f9-e01cf4297449', '147e7523-ee6d-46f1-918b-d3d70146fca2', 'fe7f166f-4f96-4355-acce-0c09e6266acd', '8beab26a-205f-4872-91de-8596eef29c59'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:40 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:14:40 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:40 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:40 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] Deleted volume successfully. Sep 17 15:14:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-10a5ecab-f197-4773-87ca-2df6c54946a8 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-56d44a9d-e998-4c6a-b3c1-bbce816bc7ab-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "cinder-28ef4486-b8d0-498d-a069-d515cb327f7d-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-28ef4486-b8d0-498d-a069-d515cb327f7d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "cinder-quobyte-28ef4486-b8d0-498d-a069-d515cb327f7d" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-quobyte-28ef4486-b8d0-498d-a069-d515cb327f7d" acquired by "delete_volume" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:41 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd20b625-42ec-4b61-8e3a-465d632268f5]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-28ef4486-b8d0-498d-a069-d515cb327f7d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:41 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-28ef4486-b8d0-498d-a069-d515cb327f7d Sep 17 15:14:41 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:41 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-28ef4486-b8d0-498d-a069-d515cb327f7d" returned: 0 in 0.359s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-28ef4486-b8d0-498d-a069-d515cb327f7d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:41 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-28ef4486-b8d0-498d-a069-d515cb327f7d Sep 17 15:14:41 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:41 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-28ef4486-b8d0-498d-a069-d515cb327f7d" returned: 0 in 0.247s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-quobyte-28ef4486-b8d0-498d-a069-d515cb327f7d" released by "delete_volume" :: held 0.644s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:41 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] Created reservations ['1eb80b3d-6be3-46ce-a754-f0f0d683bca3', '16ea902b-10f7-45c1-83b0-7447e80aa5ad', '1c2f08e3-9d80-4ec8-b6aa-0aa46127df40', '38ef837e-f6e4-4dc3-9e71-7afcd0105b15'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:41 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:14:41 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:42 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:42 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:42 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] Deleted volume successfully. Sep 17 15:14:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3f46238d-f032-4fed-94f5-ab4fe051dc2b tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-28ef4486-b8d0-498d-a069-d515cb327f7d-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "cinder-0c0d406a-68d5-4a66-b8e7-3558b3852c25-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-0c0d406a-68d5-4a66-b8e7-3558b3852c25-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "cinder-quobyte-0c0d406a-68d5-4a66-b8e7-3558b3852c25" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-quobyte-0c0d406a-68d5-4a66-b8e7-3558b3852c25" acquired by "delete_volume" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:42 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8754b366-ddce-4857-a13c-c86ce7fe3063]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0c0d406a-68d5-4a66-b8e7-3558b3852c25 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:42 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0c0d406a-68d5-4a66-b8e7-3558b3852c25 Sep 17 15:14:42 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:42 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0c0d406a-68d5-4a66-b8e7-3558b3852c25" returned: 0 in 0.359s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0c0d406a-68d5-4a66-b8e7-3558b3852c25 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:42 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0c0d406a-68d5-4a66-b8e7-3558b3852c25 Sep 17 15:14:42 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:42 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-0c0d406a-68d5-4a66-b8e7-3558b3852c25" returned: 0 in 0.245s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-quobyte-0c0d406a-68d5-4a66-b8e7-3558b3852c25" released by "delete_volume" :: held 0.644s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:42 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] Created reservations ['ce545ed2-f511-4d35-a409-3218f7d8cac8', '6e3ca13e-83e0-41fb-abc8-7fa339f4403b', 'a96481d7-3eb0-4902-8ae1-630656efbff3', 'adfbb3c7-2305-4bb9-90d8-be3d90b545cb'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:43 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:14:43 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:43 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.237s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:43 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:43 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] Deleted volume successfully. Sep 17 15:14:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-74af757f-7b27-46d7-931c-e54d49bfa925 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-0c0d406a-68d5-4a66-b8e7-3558b3852c25-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "cinder-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "cinder-quobyte-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-quobyte-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[06498b35-ba7a-4ab4-8cc9-5733d9122dd7]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:43 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9 Sep 17 15:14:43 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:43 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9" returned: 0 in 0.353s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:43 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9 Sep 17 15:14:43 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:44 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9" returned: 0 in 0.237s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-quobyte-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9" released by "delete_volume" :: held 0.629s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Created reservations ['f902da98-9cdb-47f3-9de9-acac88c02465', 'a2cb6315-6a58-48eb-8f55-e2ef02046a7e', '5d0f9d0f-d6bb-48b0-af9c-8b506aceb5f8', '9e87cff1-a70f-4561-a45c-c969a783cf88'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:44 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:14:44 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:44 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.238s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Deleted volume successfully. Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-41cfb167-bedf-49d3-ba4c-6dc2ff010cd3 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-934f8f09-44e8-4a2b-a1d0-f81fb72c81b9-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "cinder-b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "cinder-quobyte-fb2727f6-83c3-4911-ab67-54ec921a1268" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-quobyte-fb2727f6-83c3-4911-ab67-54ec921a1268" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "cinder-quobyte-b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-quobyte-b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] Deleting offline snapshot b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c of volume fb2727f6-83c3-4911-ab67-54ec921a1268 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] snapshot_file for this snap is: volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[24722315-7d41-432a-a42d-e2f5c4ecfc93]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:44 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c Sep 17 15:14:44 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:44 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c" returned: 0 in 0.362s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb2727f6-83c3-4911-ab67-54ec921a1268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c8051a-ce24-4772-9617-24fbea5cad9e]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:45 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268 Sep 17 15:14:45 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:45 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268" returned: 0 in 0.354s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:45 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c Sep 17 15:14:45 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:45 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c" returned: 0 in 0.330s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:45 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c Sep 17 15:14:45 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:45 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268.b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-quobyte-b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c" released by "_delete_snapshot" :: held 1.405s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-quobyte-fb2727f6-83c3-4911-ab67-54ec921a1268" released by "delete_snapshot" :: held 1.427s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:46 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] Created reservations ['c4201062-84e1-42ad-a862-4e0fec36ccab', '385faebc-daff-40b3-b820-a9882c628764', '9c42fafd-d27e-491f-b05e-863ad6613e55', 'cc5e35da-11e8-45f0-93d3-6d3c9241cf0c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] Delete snapshot completed successfully. Sep 17 15:14:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eeef7104-3639-4f72-b890-b80910a1eba7 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-b0dccf75-7264-4b2b-ae7d-3fffa2ca6e2c-delete_snapshot" released by "delete_snapshot" :: held 1.553s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "cinder-fb2727f6-83c3-4911-ab67-54ec921a1268-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-fb2727f6-83c3-4911-ab67-54ec921a1268-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "cinder-quobyte-fb2727f6-83c3-4911-ab67-54ec921a1268" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-quobyte-fb2727f6-83c3-4911-ab67-54ec921a1268" acquired by "delete_volume" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:46 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[53618015-e7aa-44c6-a38c-09632be4f9e8]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:46 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268 Sep 17 15:14:46 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:47 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268" returned: 0 in 0.349s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:47 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268 Sep 17 15:14:47 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:47 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb2727f6-83c3-4911-ab67-54ec921a1268" returned: 0 in 0.238s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-quobyte-fb2727f6-83c3-4911-ab67-54ec921a1268" released by "delete_volume" :: held 0.646s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:47 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] Created reservations ['88dedcf9-e893-40d0-8029-a127f5883d98', 'f934aab2-ae93-44a3-90e4-57389e9f2b5d', 'a9ff6f31-5c88-45c5-aa80-f1ce6bb6a005', 'b8652f97-f571-4ead-b9b2-cec603764cd6'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:47 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:14:47 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:47 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.249s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:47 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:47 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] Deleted volume successfully. Sep 17 15:14:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65318c2f-7ef3-4990-aaf1-2325952e2d32 tempest-CreateVolumesFromSnapshotTest-413359341 None] Lock "cinder-fb2727f6-83c3-4911-ab67-54ec921a1268-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Flow 'volume_create_manager' (802a3dd7-f1e4-4185-a8e1-d5cc96d1bf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8582dd08-7c90-4d52-be5d-c585963d1e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8582dd08-7c90-4d52-be5d-c585963d1e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44cec786-f1cf-4dd2-bdb8-579408bc2dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='025199bbfe2e47ab802bf59f6a07066e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:50Z,use_quota=True,user_id='949144cdb66a4ca0a948ba6d316df7e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704c0a0e-8722-4423-96e1-7f8460a42bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704c0a0e-8722-4423-96e1-7f8460a42bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7693e219-481a-4987-a654-72759d607c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7693e219-481a-4987-a654-72759d607c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44cec786-f1cf-4dd2-bdb8-579408bc2dc7', 'volume_name': 'volume-44cec786-f1cf-4dd2-bdb8-579408bc2dc7', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1344d2fb-a52b-4e3f-95f7-b385d006d486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1344d2fb-a52b-4e3f-95f7-b385d006d486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21d3929-7630-400b-8b94-7b24f2b08c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:50 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Volume 44cec786-f1cf-4dd2-bdb8-579408bc2dc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44cec786-f1cf-4dd2-bdb8-579408bc2dc7', 'volume_size': 1} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44cec786-f1cf-4dd2-bdb8-579408bc2dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='025199bbfe2e47ab802bf59f6a07066e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:50Z,use_quota=True,user_id='949144cdb66a4ca0a948ba6d316df7e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Creating volume 44cec786-f1cf-4dd2-bdb8-579408bc2dc7 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:14:50 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-44cec786-f1cf-4dd2-bdb8-579408bc2dc7 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:50 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-44cec786-f1cf-4dd2-bdb8-579408bc2dc7 1073741824 Sep 17 15:14:50 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:50 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-44cec786-f1cf-4dd2-bdb8-579408bc2dc7 1073741824" returned: 0 in 0.406s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-44cec786-f1cf-4dd2-bdb8-579408bc2dc7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:50 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-44cec786-f1cf-4dd2-bdb8-579408bc2dc7 Sep 17 15:14:50 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:51 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-44cec786-f1cf-4dd2-bdb8-579408bc2dc7" returned: 0 in 0.242s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21d3929-7630-400b-8b94-7b24f2b08c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44cec786-f1cf-4dd2-bdb8-579408bc2dc7', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d2a5f7b-3a48-4b06-a63d-deb3689c4f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Volume volume-44cec786-f1cf-4dd2-bdb8-579408bc2dc7 (44cec786-f1cf-4dd2-bdb8-579408bc2dc7): created successfully Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d2a5f7b-3a48-4b06-a63d-deb3689c4f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Flow 'volume_create_manager' (802a3dd7-f1e4-4185-a8e1-d5cc96d1bf47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1ac57aa5-9928-4fed-ae7e-db36b5989f36 tempest-CinderUnicodeTest-1429104234 None] Created volume successfully. Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Flow 'volume_create_manager' (3e513cab-3d82-48a2-bb00-4be780ec163b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2b9b8c-7e36-47a3-ae72-5d3545603334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a2b9b8c-7e36-47a3-ae72-5d3545603334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-755933953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660b616d-a569-46e7-b8f1-d2044613f0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='025199bbfe2e47ab802bf59f6a07066e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:52Z,use_quota=True,user_id='949144cdb66a4ca0a948ba6d316df7e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa77782f-0739-4b58-912b-073eb5d7feaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa77782f-0739-4b58-912b-073eb5d7feaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b3eb9cf-3518-4913-81a7-172f0f6de27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b3eb9cf-3518-4913-81a7-172f0f6de27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '660b616d-a569-46e7-b8f1-d2044613f0a2', 'volume_name': 'volume-660b616d-a569-46e7-b8f1-d2044613f0a2', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ad9b21-eb7f-4e2e-af4f-1478c6e5a745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ad9b21-eb7f-4e2e-af4f-1478c6e5a745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95fc47d1-898a-436a-9481-c29c5bfd2ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Volume 660b616d-a569-46e7-b8f1-d2044613f0a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-660b616d-a569-46e7-b8f1-d2044613f0a2', 'volume_size': 1} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-755933953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=660b616d-a569-46e7-b8f1-d2044613f0a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='025199bbfe2e47ab802bf59f6a07066e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:52Z,use_quota=True,user_id='949144cdb66a4ca0a948ba6d316df7e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Creating volume 660b616d-a569-46e7-b8f1-d2044613f0a2 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:14:51 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:14:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:51 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2 1073741824 Sep 17 15:14:51 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:52 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2 1073741824" returned: 0 in 0.399s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:52 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2 Sep 17 15:14:52 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:52 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2" returned: 0 in 0.240s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:14:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95fc47d1-898a-436a-9481-c29c5bfd2ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-660b616d-a569-46e7-b8f1-d2044613f0a2', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a05f613-da5c-4f12-b5ed-97c0325079c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:52 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Volume volume-660b616d-a569-46e7-b8f1-d2044613f0a2 (660b616d-a569-46e7-b8f1-d2044613f0a2): created successfully Sep 17 15:14:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a05f613-da5c-4f12-b5ed-97c0325079c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Flow 'volume_create_manager' (3e513cab-3d82-48a2-bb00-4be780ec163b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d5c5a6dc-8f9b-450d-b518-c95060b60908 tempest-CinderUnicodeTest-1429104234 None] Created volume successfully. Sep 17 15:14:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] Creating offline snapshot 0f045186-91de-4ee4-8dff-d2e63cd97f07 of volume 660b616d-a569-46e7-b8f1-d2044613f0a2 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:14:53 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab954cc2-c0a4-4f2d-8737-d38ab3339a18]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:53 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2 Sep 17 15:14:53 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:53 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2" returned: 0 in 0.356s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:53 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07 1G Sep 17 15:14:53 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:53 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07 1G" returned: 0 in 0.388s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-660b616d-a569-46e7-b8f1-d2044613f0a2 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:53 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-660b616d-a569-46e7-b8f1-d2044613f0a2 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07 Sep 17 15:14:53 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:54 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-660b616d-a569-46e7-b8f1-d2044613f0a2 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07" returned: 0 in 0.293s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:54 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07 is being set with open permissions: ugo+rw Sep 17 15:14:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:54 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07 Sep 17 15:14:54 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:54 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:54 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.info Sep 17 15:14:54 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:54 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.info" returned: 0 in 0.260s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:54 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.info is being set with open permissions: ugo+rw Sep 17 15:14:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:54 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.info Sep 17 15:14:54 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:54 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.info" returned: 0 in 0.241s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.869s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:54 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-aa70bb29-9a7c-4b31-9c65-72cd138817e7 tempest-CinderUnicodeTest-1429104234 None] Create snapshot completed successfully Sep 17 15:14:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] Acquiring lock "cinder-0f045186-91de-4ee4-8dff-d2e63cd97f07-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] Lock "cinder-0f045186-91de-4ee4-8dff-d2e63cd97f07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] Acquiring lock "cinder-quobyte-660b616d-a569-46e7-b8f1-d2044613f0a2" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] Lock "cinder-quobyte-660b616d-a569-46e7-b8f1-d2044613f0a2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] Acquiring lock "cinder-quobyte-0f045186-91de-4ee4-8dff-d2e63cd97f07" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] Lock "cinder-quobyte-0f045186-91de-4ee4-8dff-d2e63cd97f07" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] Deleting offline snapshot 0f045186-91de-4ee4-8dff-d2e63cd97f07 of volume 660b616d-a569-46e7-b8f1-d2044613f0a2 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:14:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] snapshot_file for this snap is: volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:14:55 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0998bd12-f179-44af-ad0c-9b7ffc37ee35]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:55 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07 Sep 17 15:14:55 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:55 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07" returned: 0 in 0.381s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-660b616d-a569-46e7-b8f1-d2044613f0a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:14:55 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3152247b-cd7c-4bfd-8d36-c7975ee7a736]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:55 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2 Sep 17 15:14:55 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:56 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2" returned: 0 in 0.364s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:56 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07 Sep 17 15:14:56 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:56 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07" returned: 0 in 0.352s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:56 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07 Sep 17 15:14:56 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:56 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2.0f045186-91de-4ee4-8dff-d2e63cd97f07" returned: 0 in 0.263s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] Lock "cinder-quobyte-0f045186-91de-4ee4-8dff-d2e63cd97f07" released by "_delete_snapshot" :: held 1.472s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] Lock "cinder-quobyte-660b616d-a569-46e7-b8f1-d2044613f0a2" released by "delete_snapshot" :: held 1.494s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:56 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] Created reservations ['fe99dfa2-1f2d-4a8e-8406-6d55d3e27e2f', '3634793b-d5b7-43e1-a1b9-28ed34502642', '14b92c91-7dfa-4b7b-9208-489a034d945e', 'a3c99818-e825-46e5-98fb-066f0032beff'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:56 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] Delete snapshot completed successfully. Sep 17 15:14:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-163a4512-5204-49e4-b653-ccbf7725d907 tempest-CinderUnicodeTest-1429104234 None] Lock "cinder-0f045186-91de-4ee4-8dff-d2e63cd97f07-delete_snapshot" released by "delete_snapshot" :: held 1.622s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] Acquiring lock "cinder-660b616d-a569-46e7-b8f1-d2044613f0a2-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] Lock "cinder-660b616d-a569-46e7-b8f1-d2044613f0a2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] Acquiring lock "cinder-quobyte-660b616d-a569-46e7-b8f1-d2044613f0a2" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] Lock "cinder-quobyte-660b616d-a569-46e7-b8f1-d2044613f0a2" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:57 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c29cba-d3e3-425b-9c4b-10b132737232]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:57 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2 Sep 17 15:14:57 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:57 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2" returned: 0 in 0.374s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:57 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2 Sep 17 15:14:57 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:58 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-660b616d-a569-46e7-b8f1-d2044613f0a2" returned: 0 in 0.247s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] Lock "cinder-quobyte-660b616d-a569-46e7-b8f1-d2044613f0a2" released by "delete_volume" :: held 0.693s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] Created reservations ['48b534a1-f758-4610-98bd-79d413dd6661', '96c0cc30-d6b6-4b5b-a15d-fe63f87d0079', '38361f55-bec3-4975-9b60-4000a9e37df5', 'd25c44a4-84cb-4d1b-866f-5c6680a90948'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:58 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:14:58 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:58 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.253s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:58 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] Deleted volume successfully. Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aec20a27-0ec2-43cf-9a9e-9f7fc94a5297 tempest-CinderUnicodeTest-1429104234 None] Lock "cinder-660b616d-a569-46e7-b8f1-d2044613f0a2-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] Acquiring lock "cinder-44cec786-f1cf-4dd2-bdb8-579408bc2dc7-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] Lock "cinder-44cec786-f1cf-4dd2-bdb8-579408bc2dc7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] Acquiring lock "cinder-quobyte-44cec786-f1cf-4dd2-bdb8-579408bc2dc7" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] Lock "cinder-quobyte-44cec786-f1cf-4dd2-bdb8-579408bc2dc7" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d050ca-3db8-4b27-a79a-16a737dd874b]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-44cec786-f1cf-4dd2-bdb8-579408bc2dc7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:58 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-44cec786-f1cf-4dd2-bdb8-579408bc2dc7 Sep 17 15:14:58 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:58 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-44cec786-f1cf-4dd2-bdb8-579408bc2dc7" returned: 0 in 0.355s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-44cec786-f1cf-4dd2-bdb8-579408bc2dc7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:58 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-44cec786-f1cf-4dd2-bdb8-579408bc2dc7 Sep 17 15:14:58 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:59 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-44cec786-f1cf-4dd2-bdb8-579408bc2dc7" returned: 0 in 0.238s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] Lock "cinder-quobyte-44cec786-f1cf-4dd2-bdb8-579408bc2dc7" released by "delete_volume" :: held 0.639s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:59 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] Created reservations ['1151ed57-14cd-4e48-9e6f-ab8d039ba4dc', 'cd60ca28-96ce-4031-bc7e-f97b9c354844', 'a7126649-4291-4d0e-8c90-f6850d038a65', '1c13797b-79b5-468f-8793-161cf4178e77'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:59 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:14:59 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:59 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:59 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] Deleted volume successfully. Sep 17 15:14:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6d5faae6-454a-4263-b3c4-c55f5f1d08ac tempest-CinderUnicodeTest-1429104234 None] Lock "cinder-44cec786-f1cf-4dd2-bdb8-579408bc2dc7-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Flow 'volume_create_manager' (5ee7079a-5a26-4cc5-a1a4-923fafb05407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36e640d-0886-4013-a517-2b6b6cc439fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36e640d-0886-4013-a517-2b6b6cc439fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1916426680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831b60ce-133b-4b1b-b413-4b8f2c740b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab290d36c644aec967c2bbbdfa48c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:07Z,use_quota=True,user_id='d4eeb7fb53ea4f5a949d20698c7157b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9c8d11-222c-43be-a9d7-deb111df8029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9c8d11-222c-43be-a9d7-deb111df8029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f94514-199a-4c24-ba56-ca61f404be8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97f94514-199a-4c24-ba56-ca61f404be8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '831b60ce-133b-4b1b-b413-4b8f2c740b1f', 'volume_name': 'volume-831b60ce-133b-4b1b-b413-4b8f2c740b1f', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a69f14-14b7-4af5-a24a-4108a3c09fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39a69f14-14b7-4af5-a24a-4108a3c09fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57cb5fdf-1008-493f-a935-188d5c6529c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:07 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Volume 831b60ce-133b-4b1b-b413-4b8f2c740b1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-831b60ce-133b-4b1b-b413-4b8f2c740b1f', 'volume_size': 1} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1916426680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831b60ce-133b-4b1b-b413-4b8f2c740b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab290d36c644aec967c2bbbdfa48c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:07Z,use_quota=True,user_id='d4eeb7fb53ea4f5a949d20698c7157b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Creating volume 831b60ce-133b-4b1b-b413-4b8f2c740b1f {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:07 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-831b60ce-133b-4b1b-b413-4b8f2c740b1f 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:07 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-831b60ce-133b-4b1b-b413-4b8f2c740b1f 1073741824 Sep 17 15:15:07 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:07 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-831b60ce-133b-4b1b-b413-4b8f2c740b1f 1073741824" returned: 0 in 0.413s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-831b60ce-133b-4b1b-b413-4b8f2c740b1f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:07 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-831b60ce-133b-4b1b-b413-4b8f2c740b1f Sep 17 15:15:07 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:08 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-831b60ce-133b-4b1b-b413-4b8f2c740b1f" returned: 0 in 0.242s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57cb5fdf-1008-493f-a935-188d5c6529c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-831b60ce-133b-4b1b-b413-4b8f2c740b1f', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e64f4d-32f5-42b9-b994-8971402cd003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:08 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Volume volume-831b60ce-133b-4b1b-b413-4b8f2c740b1f (831b60ce-133b-4b1b-b413-4b8f2c740b1f): created successfully Sep 17 15:15:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48e64f4d-32f5-42b9-b994-8971402cd003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Flow 'volume_create_manager' (5ee7079a-5a26-4cc5-a1a4-923fafb05407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:08 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-13c44812-4acb-4b35-bbe4-9e4f9e2cc2a9 tempest-ProjectReaderTests-750834995 None] Created volume successfully. Sep 17 15:15:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] Acquiring lock "cinder-831b60ce-133b-4b1b-b413-4b8f2c740b1f-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] Lock "cinder-831b60ce-133b-4b1b-b413-4b8f2c740b1f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] Acquiring lock "cinder-quobyte-831b60ce-133b-4b1b-b413-4b8f2c740b1f" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] Lock "cinder-quobyte-831b60ce-133b-4b1b-b413-4b8f2c740b1f" acquired by "delete_volume" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:08 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[56810c8f-faa1-497c-9930-f488604ab599]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-831b60ce-133b-4b1b-b413-4b8f2c740b1f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:08 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-831b60ce-133b-4b1b-b413-4b8f2c740b1f Sep 17 15:15:08 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:08 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-831b60ce-133b-4b1b-b413-4b8f2c740b1f" returned: 0 in 0.361s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-831b60ce-133b-4b1b-b413-4b8f2c740b1f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:08 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-831b60ce-133b-4b1b-b413-4b8f2c740b1f Sep 17 15:15:08 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:09 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-831b60ce-133b-4b1b-b413-4b8f2c740b1f" returned: 0 in 0.246s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] Lock "cinder-quobyte-831b60ce-133b-4b1b-b413-4b8f2c740b1f" released by "delete_volume" :: held 0.646s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:09 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] Created reservations ['c43b9e93-0daa-4e6c-ace2-de45ef938c43', 'b1b1d45a-059b-46e6-b636-20b6c7856866', '9a076b75-9222-47ef-97ef-9727dad41540', 'f4c1ff08-cbf5-49f6-811a-c4d7a7ab9f9a'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:09 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:15:09 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:09 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.241s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:09 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:09 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] Deleted volume successfully. Sep 17 15:15:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d36cd8d1-a990-4f9e-b407-66cbfddb1277 tempest-ProjectReaderTests-750834995 None] Lock "cinder-831b60ce-133b-4b1b-b413-4b8f2c740b1f-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:09 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Flow 'volume_create_manager' (91c0e28b-9748-4c9b-8124-7cdd52518637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb74def-c501-4d4a-b028-82dae5b7b62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb74def-c501-4d4a-b028-82dae5b7b62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-878199629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166ac8e8-4cb8-4606-92b0-3e745338190a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab290d36c644aec967c2bbbdfa48c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:10Z,use_quota=True,user_id='d4eeb7fb53ea4f5a949d20698c7157b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320042f8-c8de-44f1-8419-a49c9d0cf4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320042f8-c8de-44f1-8419-a49c9d0cf4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6c7566-5a9b-4c2f-9c22-b45d54e1e084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6c7566-5a9b-4c2f-9c22-b45d54e1e084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '166ac8e8-4cb8-4606-92b0-3e745338190a', 'volume_name': 'volume-166ac8e8-4cb8-4606-92b0-3e745338190a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0a538a-512e-4dd6-a77c-d5c492168d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0a538a-512e-4dd6-a77c-d5c492168d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886c2250-c72d-4826-a257-8e2e733da7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:10 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Volume 166ac8e8-4cb8-4606-92b0-3e745338190a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-166ac8e8-4cb8-4606-92b0-3e745338190a', 'volume_size': 1} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-878199629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166ac8e8-4cb8-4606-92b0-3e745338190a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab290d36c644aec967c2bbbdfa48c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:10Z,use_quota=True,user_id='d4eeb7fb53ea4f5a949d20698c7157b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Creating volume 166ac8e8-4cb8-4606-92b0-3e745338190a {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:10 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-166ac8e8-4cb8-4606-92b0-3e745338190a 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:10 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-166ac8e8-4cb8-4606-92b0-3e745338190a 1073741824 Sep 17 15:15:10 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:10 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-166ac8e8-4cb8-4606-92b0-3e745338190a 1073741824" returned: 0 in 0.413s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-166ac8e8-4cb8-4606-92b0-3e745338190a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:10 devstack sudo[105193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-166ac8e8-4cb8-4606-92b0-3e745338190a Sep 17 15:15:10 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:10 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-166ac8e8-4cb8-4606-92b0-3e745338190a" returned: 0 in 0.246s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886c2250-c72d-4826-a257-8e2e733da7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-166ac8e8-4cb8-4606-92b0-3e745338190a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9022cd4e-bfe7-43fa-b152-5c4397abb64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:10 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Volume volume-166ac8e8-4cb8-4606-92b0-3e745338190a (166ac8e8-4cb8-4606-92b0-3e745338190a): created successfully Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9022cd4e-bfe7-43fa-b152-5c4397abb64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Flow 'volume_create_manager' (91c0e28b-9748-4c9b-8124-7cdd52518637) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7268466d-6a1f-4b97-80d8-de9d59c35f2f tempest-ProjectReaderTests-750834995 None] Created volume successfully. Sep 17 15:15:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] Acquiring lock "cinder-166ac8e8-4cb8-4606-92b0-3e745338190a-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] Lock "cinder-166ac8e8-4cb8-4606-92b0-3e745338190a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] Acquiring lock "cinder-quobyte-166ac8e8-4cb8-4606-92b0-3e745338190a" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] Lock "cinder-quobyte-166ac8e8-4cb8-4606-92b0-3e745338190a" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:11 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[49093cc3-69a2-46ee-a05b-3718613586d2]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-166ac8e8-4cb8-4606-92b0-3e745338190a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:11 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-166ac8e8-4cb8-4606-92b0-3e745338190a Sep 17 15:15:11 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:11 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-166ac8e8-4cb8-4606-92b0-3e745338190a" returned: 0 in 0.359s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-166ac8e8-4cb8-4606-92b0-3e745338190a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:11 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-166ac8e8-4cb8-4606-92b0-3e745338190a Sep 17 15:15:11 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:11 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-166ac8e8-4cb8-4606-92b0-3e745338190a" returned: 0 in 0.250s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] Lock "cinder-quobyte-166ac8e8-4cb8-4606-92b0-3e745338190a" released by "delete_volume" :: held 0.650s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:11 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] Created reservations ['dc46608c-e6a6-481e-985b-0847128c91c4', 'f1a5c90e-0258-43ca-b2ff-5e95a168722e', 'a6ba3bc8-00fe-4b6c-8843-78e31d13b318', '2d781bdf-08d3-4a28-8cff-fb14b64f0c0d'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:11 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:15:11 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:12 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.249s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:12 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] Deleted volume successfully. Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65b74d21-b844-42c6-abde-5ad362f3cdc6 tempest-ProjectReaderTests-750834995 None] Lock "cinder-166ac8e8-4cb8-4606-92b0-3e745338190a-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Flow 'volume_create_manager' (fdc03394-9552-44e2-bc3c-f58102d7f1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c88c6d89-440e-489a-811e-9ee279598317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c88c6d89-440e-489a-811e-9ee279598317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-339448733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9e194f-8e68-47e6-b438-880dabfaa0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab290d36c644aec967c2bbbdfa48c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:13Z,use_quota=True,user_id='d4eeb7fb53ea4f5a949d20698c7157b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a96510-bf81-4533-89a7-0c05c272c43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a96510-bf81-4533-89a7-0c05c272c43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c94d736-06ed-4f45-9869-dbda1f70c7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c94d736-06ed-4f45-9869-dbda1f70c7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a9e194f-8e68-47e6-b438-880dabfaa0db', 'volume_name': 'volume-2a9e194f-8e68-47e6-b438-880dabfaa0db', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a88f49-9d31-4419-93d4-5dbbf4f96f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a88f49-9d31-4419-93d4-5dbbf4f96f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcbed503-b035-4df4-8e3d-8aee8baac9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:12 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Volume 2a9e194f-8e68-47e6-b438-880dabfaa0db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a9e194f-8e68-47e6-b438-880dabfaa0db', 'volume_size': 1} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-339448733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a9e194f-8e68-47e6-b438-880dabfaa0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab290d36c644aec967c2bbbdfa48c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:13Z,use_quota=True,user_id='d4eeb7fb53ea4f5a949d20698c7157b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Creating volume 2a9e194f-8e68-47e6-b438-880dabfaa0db {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:12 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2a9e194f-8e68-47e6-b438-880dabfaa0db 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:12 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2a9e194f-8e68-47e6-b438-880dabfaa0db 1073741824 Sep 17 15:15:12 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:13 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2a9e194f-8e68-47e6-b438-880dabfaa0db 1073741824" returned: 0 in 0.416s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2a9e194f-8e68-47e6-b438-880dabfaa0db {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:13 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2a9e194f-8e68-47e6-b438-880dabfaa0db Sep 17 15:15:13 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:13 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2a9e194f-8e68-47e6-b438-880dabfaa0db" returned: 0 in 0.245s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcbed503-b035-4df4-8e3d-8aee8baac9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a9e194f-8e68-47e6-b438-880dabfaa0db', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084d8e78-5ab9-4540-b885-e10ade02ce23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:13 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Volume volume-2a9e194f-8e68-47e6-b438-880dabfaa0db (2a9e194f-8e68-47e6-b438-880dabfaa0db): created successfully Sep 17 15:15:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084d8e78-5ab9-4540-b885-e10ade02ce23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Flow 'volume_create_manager' (fdc03394-9552-44e2-bc3c-f58102d7f1ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:13 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f641460e-fdda-41ec-aa5d-d8725db3d6be tempest-ProjectReaderTests-750834995 None] Created volume successfully. Sep 17 15:15:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] Acquiring lock "cinder-2a9e194f-8e68-47e6-b438-880dabfaa0db-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] Lock "cinder-2a9e194f-8e68-47e6-b438-880dabfaa0db-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] Acquiring lock "cinder-quobyte-2a9e194f-8e68-47e6-b438-880dabfaa0db" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] Lock "cinder-quobyte-2a9e194f-8e68-47e6-b438-880dabfaa0db" acquired by "delete_volume" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:13 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbf1c44-4656-439d-9aef-aaf54bf59c36]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2a9e194f-8e68-47e6-b438-880dabfaa0db {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:13 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2a9e194f-8e68-47e6-b438-880dabfaa0db Sep 17 15:15:13 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:14 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2a9e194f-8e68-47e6-b438-880dabfaa0db" returned: 0 in 0.353s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2a9e194f-8e68-47e6-b438-880dabfaa0db {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:14 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2a9e194f-8e68-47e6-b438-880dabfaa0db Sep 17 15:15:14 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:14 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-2a9e194f-8e68-47e6-b438-880dabfaa0db" returned: 0 in 0.238s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] Lock "cinder-quobyte-2a9e194f-8e68-47e6-b438-880dabfaa0db" released by "delete_volume" :: held 0.633s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:14 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] Created reservations ['69637d11-d40a-446a-bc1f-339cfb656ba1', 'b6da0af0-981b-4007-b6f3-08cd0eba1b86', '5d5200f4-1992-4f7b-a1ae-5caae83e7a7e', '825017c9-43e6-4872-a849-3ce5b0ff96c8'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:14 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:15:14 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:14 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.253s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:14 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] Deleted volume successfully. Sep 17 15:15:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-546caa12-0980-4803-8089-917ec32e5429 tempest-ProjectReaderTests-750834995 None] Lock "cinder-2a9e194f-8e68-47e6-b438-880dabfaa0db-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Flow 'volume_create_manager' (e25ae3ef-07f6-4491-8af8-5223f4cdd333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c33fc8bd-6cdd-449a-818f-62f69a8d34ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c33fc8bd-6cdd-449a-818f-62f69a8d34ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1837971240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62526363-ee99-49ee-8981-025b5809af97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab290d36c644aec967c2bbbdfa48c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:15Z,use_quota=True,user_id='d4eeb7fb53ea4f5a949d20698c7157b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da13624d-43f6-4ab1-8d78-a0b9eaf981bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da13624d-43f6-4ab1-8d78-a0b9eaf981bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5291974f-b39c-4733-a00e-181793947c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5291974f-b39c-4733-a00e-181793947c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62526363-ee99-49ee-8981-025b5809af97', 'volume_name': 'volume-62526363-ee99-49ee-8981-025b5809af97', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32354009-99ac-4920-b4ba-10eeb1618577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32354009-99ac-4920-b4ba-10eeb1618577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0cbe026-c247-4374-9e57-64b5750403f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:15 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Volume 62526363-ee99-49ee-8981-025b5809af97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62526363-ee99-49ee-8981-025b5809af97', 'volume_size': 1} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1837971240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62526363-ee99-49ee-8981-025b5809af97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab290d36c644aec967c2bbbdfa48c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:15Z,use_quota=True,user_id='d4eeb7fb53ea4f5a949d20698c7157b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Creating volume 62526363-ee99-49ee-8981-025b5809af97 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:15 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-62526363-ee99-49ee-8981-025b5809af97 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:15 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-62526363-ee99-49ee-8981-025b5809af97 1073741824 Sep 17 15:15:15 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:15 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-62526363-ee99-49ee-8981-025b5809af97 1073741824" returned: 0 in 0.425s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-62526363-ee99-49ee-8981-025b5809af97 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:15 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-62526363-ee99-49ee-8981-025b5809af97 Sep 17 15:15:15 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:16 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-62526363-ee99-49ee-8981-025b5809af97" returned: 0 in 0.240s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0cbe026-c247-4374-9e57-64b5750403f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62526363-ee99-49ee-8981-025b5809af97', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e910ad62-e9ab-4e85-a8ce-b3d13d0b8a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:16 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Volume volume-62526363-ee99-49ee-8981-025b5809af97 (62526363-ee99-49ee-8981-025b5809af97): created successfully Sep 17 15:15:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e910ad62-e9ab-4e85-a8ce-b3d13d0b8a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Flow 'volume_create_manager' (e25ae3ef-07f6-4491-8af8-5223f4cdd333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:16 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-610def86-bddc-498d-b8bd-36efff132e50 tempest-ProjectReaderTests-750834995 None] Created volume successfully. Sep 17 15:15:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] Acquiring lock "cinder-62526363-ee99-49ee-8981-025b5809af97-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] Lock "cinder-62526363-ee99-49ee-8981-025b5809af97-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] Acquiring lock "cinder-quobyte-62526363-ee99-49ee-8981-025b5809af97" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] Lock "cinder-quobyte-62526363-ee99-49ee-8981-025b5809af97" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:16 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfecb9c-4f36-4d00-875c-a6a0c5415e7f]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-62526363-ee99-49ee-8981-025b5809af97 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:16 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-62526363-ee99-49ee-8981-025b5809af97 Sep 17 15:15:16 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:16 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-62526363-ee99-49ee-8981-025b5809af97" returned: 0 in 0.366s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-62526363-ee99-49ee-8981-025b5809af97 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:16 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-62526363-ee99-49ee-8981-025b5809af97 Sep 17 15:15:16 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:17 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-62526363-ee99-49ee-8981-025b5809af97" returned: 0 in 0.242s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] Lock "cinder-quobyte-62526363-ee99-49ee-8981-025b5809af97" released by "delete_volume" :: held 0.651s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:17 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] Created reservations ['916cc282-f793-49aa-80c2-da1f692297ae', '8b554be9-07d4-44af-a881-7f2476e4098b', '1acf8084-b8de-41da-99a9-35c63e58a29e', 'f8299500-2cfb-442b-add6-2b1702b269e5'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:17 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:15:17 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:17 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:17 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:17 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] Deleted volume successfully. Sep 17 15:15:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-79f56ba7-e633-4daa-828c-ae46e5dc6e2e tempest-ProjectReaderTests-750834995 None] Lock "cinder-62526363-ee99-49ee-8981-025b5809af97-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:27 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=155,cinder:SELECT=93,cinder:INSERT=36,cinder:DELETE=13 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:15:27 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=111,cinder:UPDATE=137,cinder:DELETE=13,cinder:INSERT=34 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Flow 'volume_create_manager' (b5293d8a-4754-4354-8d64-a93de63c6c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e63f014-03f6-49c8-99c2-61c26f832df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e63f014-03f6-49c8-99c2-61c26f832df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1529324623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5742c8faf7164b78bb59ab4219603356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:30Z,use_quota=True,user_id='3d8c979dee9d48dfa7f0765421a8953b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1356f459-8277-492e-84a4-cbdf9f6ff253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1356f459-8277-492e-84a4-cbdf9f6ff253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec78c56-2a5f-49f4-a731-2dbe2622feb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec78c56-2a5f-49f4-a731-2dbe2622feb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0', 'volume_name': 'volume-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c992e24d-2baf-43a5-bb53-8039f6e4b57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c992e24d-2baf-43a5-bb53-8039f6e4b57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ffbc5a-2d40-441b-82b5-ed72a9019dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:29 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Volume bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0', 'volume_size': 1} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1529324623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5742c8faf7164b78bb59ab4219603356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:30Z,use_quota=True,user_id='3d8c979dee9d48dfa7f0765421a8953b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Creating volume bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:29 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:29 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0 1073741824 Sep 17 15:15:30 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Flow 'volume_create_manager' (6fdb4ab9-cc8a-4e5b-82ea-049b0c54ab5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2b23e0-2c34-4981-bf59-4056919d44e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Flow 'volume_create_manager' (0a22a34e-7614-4f30-baeb-68ed4edad8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c02442c-ee8f-4ebf-8327-c6366aa363ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c02442c-ee8f-4ebf-8327-c6366aa363ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1801075302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c900e8-39ec-44f6-a2bc-1a68eea45c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74b8af40c34948a63448a5664c52a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:30Z,use_quota=True,user_id='947f374435de4ea19e01ee3000ee0e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc53fd1-7afd-47d0-ae52-b9034e64a913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc53fd1-7afd-47d0-ae52-b9034e64a913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (591f41c5-5ec8-4a9d-8da1-b363d440159e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (591f41c5-5ec8-4a9d-8da1-b363d440159e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c900e8-39ec-44f6-a2bc-1a68eea45c63', 'volume_name': 'volume-56c900e8-39ec-44f6-a2bc-1a68eea45c63', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52878c2-937e-4808-afbc-ff5c487e66e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52878c2-937e-4808-afbc-ff5c487e66e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49cffcd3-36eb-4ebe-be31-7101738f213c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:30 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Volume 56c900e8-39ec-44f6-a2bc-1a68eea45c63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c900e8-39ec-44f6-a2bc-1a68eea45c63', 'volume_size': 1} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2b23e0-2c34-4981-bf59-4056919d44e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-597350292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53be934b-70fe-4cb2-b377-201f158aeb62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5742c8faf7164b78bb59ab4219603356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:30Z,use_quota=True,user_id='3d8c979dee9d48dfa7f0765421a8953b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d3c04a-dd6f-4e83-9bbc-6bd344fc332b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99d3c04a-dd6f-4e83-9bbc-6bd344fc332b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0ef09c-ae44-41e5-bc8e-3fb527e61499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0ef09c-ae44-41e5-bc8e-3fb527e61499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53be934b-70fe-4cb2-b377-201f158aeb62', 'volume_name': 'volume-53be934b-70fe-4cb2-b377-201f158aeb62', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72d316c-126d-4002-a741-88eddaf0de8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72d316c-126d-4002-a741-88eddaf0de8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26beb95-805c-4518-8a3a-400389eb6447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:30 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Volume 53be934b-70fe-4cb2-b377-201f158aeb62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53be934b-70fe-4cb2-b377-201f158aeb62', 'volume_size': 1} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Flow 'volume_create_manager' (09ad569e-8d4b-4bd5-9b2d-3e4a7c9b3201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be601d02-4f93-4713-8410-98a468e1dc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be601d02-4f93-4713-8410-98a468e1dc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-556924541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bec70f-94e7-41fe-aa82-a67298a7b38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5742c8faf7164b78bb59ab4219603356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:30Z,use_quota=True,user_id='3d8c979dee9d48dfa7f0765421a8953b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c108165f-8618-4c95-b248-d5288429f490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c108165f-8618-4c95-b248-d5288429f490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb8743a5-8402-4544-bfc4-5d09e984047b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb8743a5-8402-4544-bfc4-5d09e984047b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68bec70f-94e7-41fe-aa82-a67298a7b38e', 'volume_name': 'volume-68bec70f-94e7-41fe-aa82-a67298a7b38e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3f5c6a-d8f0-4224-9975-47ded7139253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3f5c6a-d8f0-4224-9975-47ded7139253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aebe812-7bb0-44b4-a5b1-492e9040d55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:30 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Volume 68bec70f-94e7-41fe-aa82-a67298a7b38e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68bec70f-94e7-41fe-aa82-a67298a7b38e', 'volume_size': 1} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:30 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0 1073741824" returned: 0 in 0.739s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:30 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0 Sep 17 15:15:30 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:30 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Flow 'volume_create_manager' (617e4e3a-d7ca-4eb9-ac2d-63a653388e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8210b47-bc7f-4907-8703-39f83a789788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8210b47-bc7f-4907-8703-39f83a789788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1512719625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40766573-3458-474e-956c-e8bdf7df2c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5742c8faf7164b78bb59ab4219603356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:31Z,use_quota=True,user_id='3d8c979dee9d48dfa7f0765421a8953b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1bb772-d395-454d-90f1-7548cb02ba2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1bb772-d395-454d-90f1-7548cb02ba2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:31 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a2c7cf-4612-4c8e-a268-73965350f7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a2c7cf-4612-4c8e-a268-73965350f7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40766573-3458-474e-956c-e8bdf7df2c60', 'volume_name': 'volume-40766573-3458-474e-956c-e8bdf7df2c60', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006ccd8b-2619-432a-9609-d7b712ee0dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006ccd8b-2619-432a-9609-d7b712ee0dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a425fd7-5925-4a52-b5f3-a53a2c902c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:31 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Volume 40766573-3458-474e-956c-e8bdf7df2c60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40766573-3458-474e-956c-e8bdf7df2c60', 'volume_size': 1} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0" returned: 0 in 0.431s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1801075302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c900e8-39ec-44f6-a2bc-1a68eea45c63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74b8af40c34948a63448a5664c52a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:30Z,use_quota=True,user_id='947f374435de4ea19e01ee3000ee0e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Creating volume 56c900e8-39ec-44f6-a2bc-1a68eea45c63 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:31 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56c900e8-39ec-44f6-a2bc-1a68eea45c63 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1ffbc5a-2d40-441b-82b5-ed72a9019dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:31 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56c900e8-39ec-44f6-a2bc-1a68eea45c63 1073741824 Sep 17 15:15:31 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d2a519-4612-47d6-80a5-d2738a8c66b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:31 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Volume volume-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0 (bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0): created successfully Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d2a519-4612-47d6-80a5-d2738a8c66b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Flow 'volume_create_manager' (b5293d8a-4754-4354-8d64-a93de63c6c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-054aad7b-6a6d-4d57-8d31-58f6bc5f7d68 tempest-CreateVolumesFromImageTest-483832763 None] Created volume successfully. Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Flow 'volume_create_manager' (2b5b268d-f1f3-47e4-8d97-954eb00bc86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022c5bfa-d87e-4a58-bd36-459ce4ba21d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022c5bfa-d87e-4a58-bd36-459ce4ba21d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2033994970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b88f84-8637-4b0e-b9de-fa1890fd8634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5742c8faf7164b78bb59ab4219603356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:31Z,use_quota=True,user_id='3d8c979dee9d48dfa7f0765421a8953b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfbe15d-55d2-40c7-b7b3-c9e4201b8323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfbe15d-55d2-40c7-b7b3-c9e4201b8323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0685130d-0a1e-44f5-9995-de3b781e980e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0685130d-0a1e-44f5-9995-de3b781e980e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3b88f84-8637-4b0e-b9de-fa1890fd8634', 'volume_name': 'volume-e3b88f84-8637-4b0e-b9de-fa1890fd8634', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3dc8b80-72d5-45b0-aeae-f19679b83801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3dc8b80-72d5-45b0-aeae-f19679b83801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c03bd1-9149-4a89-8a7c-64b56d3312cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:31 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Volume e3b88f84-8637-4b0e-b9de-fa1890fd8634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3b88f84-8637-4b0e-b9de-fa1890fd8634', 'volume_size': 1} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:31 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56c900e8-39ec-44f6-a2bc-1a68eea45c63 1073741824" returned: 0 in 0.532s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56c900e8-39ec-44f6-a2bc-1a68eea45c63 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:31 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56c900e8-39ec-44f6-a2bc-1a68eea45c63 Sep 17 15:15:31 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:32 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56c900e8-39ec-44f6-a2bc-1a68eea45c63" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.820s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-597350292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53be934b-70fe-4cb2-b377-201f158aeb62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5742c8faf7164b78bb59ab4219603356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:30Z,use_quota=True,user_id='3d8c979dee9d48dfa7f0765421a8953b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Creating volume 53be934b-70fe-4cb2-b377-201f158aeb62 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:32 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53be934b-70fe-4cb2-b377-201f158aeb62 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49cffcd3-36eb-4ebe-be31-7101738f213c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c900e8-39ec-44f6-a2bc-1a68eea45c63', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:32 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53be934b-70fe-4cb2-b377-201f158aeb62 1073741824 Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d7f006-52fa-4c27-aed5-7af04c9ad4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:32 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:32 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Volume volume-56c900e8-39ec-44f6-a2bc-1a68eea45c63 (56c900e8-39ec-44f6-a2bc-1a68eea45c63): created successfully Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d7f006-52fa-4c27-aed5-7af04c9ad4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Flow 'volume_create_manager' (0a22a34e-7614-4f30-baeb-68ed4edad8c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:32 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9c69dd9b-affd-48f3-a7b2-793365b18129 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Created volume successfully. Sep 17 15:15:32 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53be934b-70fe-4cb2-b377-201f158aeb62 1073741824" returned: 0 in 0.536s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53be934b-70fe-4cb2-b377-201f158aeb62 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:32 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53be934b-70fe-4cb2-b377-201f158aeb62 Sep 17 15:15:32 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:32 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53be934b-70fe-4cb2-b377-201f158aeb62" returned: 0 in 0.320s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.470s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-556924541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bec70f-94e7-41fe-aa82-a67298a7b38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5742c8faf7164b78bb59ab4219603356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:30Z,use_quota=True,user_id='3d8c979dee9d48dfa7f0765421a8953b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Creating volume 68bec70f-94e7-41fe-aa82-a67298a7b38e {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:32 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-68bec70f-94e7-41fe-aa82-a67298a7b38e 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26beb95-805c-4518-8a3a-400389eb6447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53be934b-70fe-4cb2-b377-201f158aeb62', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdd7ab6-dfc8-4ffa-850f-fa121b7b88a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:32 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-68bec70f-94e7-41fe-aa82-a67298a7b38e 1073741824 Sep 17 15:15:32 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:33 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Volume volume-53be934b-70fe-4cb2-b377-201f158aeb62 (53be934b-70fe-4cb2-b377-201f158aeb62): created successfully Sep 17 15:15:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bdd7ab6-dfc8-4ffa-850f-fa121b7b88a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Flow 'volume_create_manager' (6fdb4ab9-cc8a-4e5b-82ea-049b0c54ab5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4786e943-6452-4bee-b860-bd7bc9bfa3f3 tempest-CreateVolumesFromImageTest-483832763 None] Created volume successfully. Sep 17 15:15:33 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Flow 'volume_create_manager' (955ac374-ccb2-4b3d-ae30-c0e585a00a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69572190-b670-4a21-877a-eb6bc29c70cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69572190-b670-4a21-877a-eb6bc29c70cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1806864691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5e14ec-9410-497b-bbb6-6ce8e07bbd58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74b8af40c34948a63448a5664c52a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:33Z,use_quota=True,user_id='947f374435de4ea19e01ee3000ee0e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b749f390-16c5-40df-8138-b427f190cc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:33 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b749f390-16c5-40df-8138-b427f190cc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55243e5f-bc4a-41bb-85ef-2a425d098fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55243e5f-bc4a-41bb-85ef-2a425d098fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d5e14ec-9410-497b-bbb6-6ce8e07bbd58', 'volume_name': 'volume-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313ed03a-5283-47e4-88e0-58d1bad932c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (313ed03a-5283-47e4-88e0-58d1bad932c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f62abe-871a-4cab-91cf-a69e8dfbb0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:33 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Volume 1d5e14ec-9410-497b-bbb6-6ce8e07bbd58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58', 'volume_size': 1} Sep 17 15:15:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-68bec70f-94e7-41fe-aa82-a67298a7b38e 1073741824" returned: 0 in 0.715s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-68bec70f-94e7-41fe-aa82-a67298a7b38e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:33 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-68bec70f-94e7-41fe-aa82-a67298a7b38e Sep 17 15:15:33 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Flow 'volume_create_manager' (5ee4adce-22bc-4553-bcef-1a378477c504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533774fa-d1ca-40e3-a320-a6e4e440f7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533774fa-d1ca-40e3-a320-a6e4e440f7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1009502348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b07aa0-1503-495c-8043-87896711167f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74b8af40c34948a63448a5664c52a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:34Z,use_quota=True,user_id='947f374435de4ea19e01ee3000ee0e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e5dd9e-d45c-491c-afee-400c32005cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e5dd9e-d45c-491c-afee-400c32005cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1b9a51-a23c-4ed7-9278-b701473e7f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d1b9a51-a23c-4ed7-9278-b701473e7f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8b07aa0-1503-495c-8043-87896711167f', 'volume_name': 'volume-c8b07aa0-1503-495c-8043-87896711167f', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1160316c-dd89-4a65-9989-efafd82bb6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1160316c-dd89-4a65-9989-efafd82bb6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8fb957-9b33-443a-957f-8e83f47ae4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:34 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Volume c8b07aa0-1503-495c-8043-87896711167f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8b07aa0-1503-495c-8043-87896711167f', 'volume_size': 1} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:34 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-68bec70f-94e7-41fe-aa82-a67298a7b38e" returned: 0 in 0.476s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.027s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1512719625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40766573-3458-474e-956c-e8bdf7df2c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5742c8faf7164b78bb59ab4219603356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:31Z,use_quota=True,user_id='3d8c979dee9d48dfa7f0765421a8953b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Creating volume 40766573-3458-474e-956c-e8bdf7df2c60 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:34 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40766573-3458-474e-956c-e8bdf7df2c60 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aebe812-7bb0-44b4-a5b1-492e9040d55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68bec70f-94e7-41fe-aa82-a67298a7b38e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a0b5f7-34c3-4f1e-8999-39d096e9b682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:34 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40766573-3458-474e-956c-e8bdf7df2c60 1073741824 Sep 17 15:15:34 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:34 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Volume volume-68bec70f-94e7-41fe-aa82-a67298a7b38e (68bec70f-94e7-41fe-aa82-a67298a7b38e): created successfully Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a0b5f7-34c3-4f1e-8999-39d096e9b682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Flow 'volume_create_manager' (09ad569e-8d4b-4bd5-9b2d-3e4a7c9b3201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:34 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d2e91e1e-09a3-4637-a44c-0e77db8fa9a9 tempest-CreateVolumesFromImageTest-483832763 None] Created volume successfully. Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Flow 'volume_create_manager' (e9cd6fa2-9014-40eb-892a-9921e4b7cfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ea80c7-e76c-45d4-9611-05a5a747b92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ea80c7-e76c-45d4-9611-05a5a747b92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-72989384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c843cde5-4698-40bc-bad5-68a71bed5666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74b8af40c34948a63448a5664c52a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:34Z,use_quota=True,user_id='947f374435de4ea19e01ee3000ee0e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e98d82-009e-4a44-be8c-9a06e632f90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e98d82-009e-4a44-be8c-9a06e632f90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5918dae2-ac64-4461-a4aa-49dd64bfc9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5918dae2-ac64-4461-a4aa-49dd64bfc9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c843cde5-4698-40bc-bad5-68a71bed5666', 'volume_name': 'volume-c843cde5-4698-40bc-bad5-68a71bed5666', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d94140-5a1c-41e2-a1f2-368c7ffa741e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d94140-5a1c-41e2-a1f2-368c7ffa741e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56658158-f72a-44f8-92a6-c9f0c7abfea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:34 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Volume c843cde5-4698-40bc-bad5-68a71bed5666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c843cde5-4698-40bc-bad5-68a71bed5666', 'volume_size': 1} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:34 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40766573-3458-474e-956c-e8bdf7df2c60 1073741824" returned: 0 in 0.711s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40766573-3458-474e-956c-e8bdf7df2c60 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:35 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40766573-3458-474e-956c-e8bdf7df2c60 Sep 17 15:15:35 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:35 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40766573-3458-474e-956c-e8bdf7df2c60" returned: 0 in 0.331s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.833s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2033994970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b88f84-8637-4b0e-b9de-fa1890fd8634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5742c8faf7164b78bb59ab4219603356',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:31Z,use_quota=True,user_id='3d8c979dee9d48dfa7f0765421a8953b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Creating volume e3b88f84-8637-4b0e-b9de-fa1890fd8634 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:35 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3b88f84-8637-4b0e-b9de-fa1890fd8634 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a425fd7-5925-4a52-b5f3-a53a2c902c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40766573-3458-474e-956c-e8bdf7df2c60', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec041ac-59d8-4465-a63f-1048837d2677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:35 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3b88f84-8637-4b0e-b9de-fa1890fd8634 1073741824 Sep 17 15:15:35 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:35 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Volume volume-40766573-3458-474e-956c-e8bdf7df2c60 (40766573-3458-474e-956c-e8bdf7df2c60): created successfully Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec041ac-59d8-4465-a63f-1048837d2677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Flow 'volume_create_manager' (617e4e3a-d7ca-4eb9-ac2d-63a653388e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:35 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-605a71ab-2636-4a0e-98c2-9bce1e607215 tempest-CreateVolumesFromImageTest-483832763 None] Created volume successfully. Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Flow 'volume_create_manager' (98b42e86-23af-4d7d-9768-e9b87b756caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad429bf-fdf5-4615-b86d-af7f519b5de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad429bf-fdf5-4615-b86d-af7f519b5de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1412435959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b422b81-8f7f-4280-9127-dcd6c843d65f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74b8af40c34948a63448a5664c52a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:35Z,use_quota=True,user_id='947f374435de4ea19e01ee3000ee0e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3457175-b2aa-4405-b94b-cd00f09e922e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3457175-b2aa-4405-b94b-cd00f09e922e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da833e83-a93a-42f5-8159-06e1f8d2885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da833e83-a93a-42f5-8159-06e1f8d2885f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b422b81-8f7f-4280-9127-dcd6c843d65f', 'volume_name': 'volume-4b422b81-8f7f-4280-9127-dcd6c843d65f', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c056b8c-0030-4677-93f3-24881e6d5099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c056b8c-0030-4677-93f3-24881e6d5099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458eb56d-290f-49af-94cf-feb81ea37459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:35 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Volume 4b422b81-8f7f-4280-9127-dcd6c843d65f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b422b81-8f7f-4280-9127-dcd6c843d65f', 'volume_size': 1} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Flow 'volume_create_manager' (ca8986a0-982d-414f-ae2a-8fb507fcf170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93681358-3590-430b-95a8-b24db1571b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93681358-3590-430b-95a8-b24db1571b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31886b78-b72e-4b8a-a926-6c764b03f79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9db3254442bd448f891200c52e5434bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:36Z,use_quota=True,user_id='86c3fd590d5446649d1f74ecbb43a119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e3d212f-9151-486b-a694-f8440eda3383),volume_type_id=9e3d212f-9151-486b-a694-f8440eda3383)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568b837c-a1ff-4d20-8a44-9bdcf6f68f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (568b837c-a1ff-4d20-8a44-9bdcf6f68f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5569519f-db04-470c-9abc-0b08292678a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Flow 'volume_create_manager' (d6a53b3a-8e1f-4f2e-9404-f48b0225c6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32d37de-e941-4dc1-a016-14440bdfd401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32d37de-e941-4dc1-a016-14440bdfd401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1298209964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdab8955-f716-421b-bbb1-9d9ac1e690fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74b8af40c34948a63448a5664c52a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:36Z,use_quota=True,user_id='947f374435de4ea19e01ee3000ee0e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7c2a4e-426c-4359-9e36-0a69b5685e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7c2a4e-426c-4359-9e36-0a69b5685e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90221407-acc2-4b3d-933b-3addff2584fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90221407-acc2-4b3d-933b-3addff2584fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdab8955-f716-421b-bbb1-9d9ac1e690fe', 'volume_name': 'volume-cdab8955-f716-421b-bbb1-9d9ac1e690fe', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e44f636-66a8-403c-9df6-aff41b5dfc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e44f636-66a8-403c-9df6-aff41b5dfc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e46e149-94b6-4904-b0df-4a93f88bbf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:35 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Volume cdab8955-f716-421b-bbb1-9d9ac1e690fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdab8955-f716-421b-bbb1-9d9ac1e690fe', 'volume_size': 1} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:35 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3b88f84-8637-4b0e-b9de-fa1890fd8634 1073741824" returned: 0 in 0.586s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3b88f84-8637-4b0e-b9de-fa1890fd8634 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:35 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3b88f84-8637-4b0e-b9de-fa1890fd8634 Sep 17 15:15:35 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5569519f-db04-470c-9abc-0b08292678a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '31886b78-b72e-4b8a-a926-6c764b03f79f', 'volume_name': 'volume-31886b78-b72e-4b8a-a926-6c764b03f79f', 'volume_size': 1, 'image_id': 'd0193bdd-3daf-418f-b5fe-4d7634dcd9d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0193bdd-3daf-418f-b5fe-4d7634dcd9d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '57ad74c89d2c9e31b84314bec8917f4d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9db3254442bd448f891200c52e5434bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd5de737fd6d698db93fe6ded9598dc2ae2caac7c3ceb1ee6879111fe954078c74799eda9a44adfbede8d498b22022c3ee21a1ad13bf249f5a77a6f3fdd74c760', 'id': 'd0193bdd-3daf-418f-b5fe-4d7634dcd9d3', 'created_at': datetime.datetime(2026, 9, 17, 13, 15, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 15, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0193bdd-3daf-418f-b5fe-4d7634dcd9d3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab02fce-d800-4efb-926e-0af58620f72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab02fce-d800-4efb-926e-0af58620f72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b963f3-914c-45f3-be64-e1de412e2b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:36 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Volume 31886b78-b72e-4b8a-a926-6c764b03f79f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-31886b78-b72e-4b8a-a926-6c764b03f79f', 'volume_size': 1, 'image_id': 'd0193bdd-3daf-418f-b5fe-4d7634dcd9d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0193bdd-3daf-418f-b5fe-4d7634dcd9d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '57ad74c89d2c9e31b84314bec8917f4d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9db3254442bd448f891200c52e5434bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd5de737fd6d698db93fe6ded9598dc2ae2caac7c3ceb1ee6879111fe954078c74799eda9a44adfbede8d498b22022c3ee21a1ad13bf249f5a77a6f3fdd74c760', 'id': 'd0193bdd-3daf-418f-b5fe-4d7634dcd9d3', 'created_at': datetime.datetime(2026, 9, 17, 13, 15, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 15, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0193bdd-3daf-418f-b5fe-4d7634dcd9d3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Trying to clone 31886b78-b72e-4b8a-a926-6c764b03f79f from image d0193bdd-3daf-418f-b5fe-4d7634dcd9d3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d0193bdd-3daf-418f-b5fe-4d7634dcd9d3', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:15:36 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3b88f84-8637-4b0e-b9de-fa1890fd8634" returned: 0 in 0.293s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.593s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1806864691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5e14ec-9410-497b-bbb6-6ce8e07bbd58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74b8af40c34948a63448a5664c52a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:33Z,use_quota=True,user_id='947f374435de4ea19e01ee3000ee0e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Creating volume 1d5e14ec-9410-497b-bbb6-6ce8e07bbd58 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:36 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 15:15:36 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Image download 0.00 MB at 0.00 MB/s Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37c03bd1-9149-4a89-8a7c-64b56d3312cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3b88f84-8637-4b0e-b9de-fa1890fd8634', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed47f8d4-f995-4415-aa71-5a10fd06f5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:36 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58 1073741824 Sep 17 15:15:36 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:36 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Volume volume-e3b88f84-8637-4b0e-b9de-fa1890fd8634 (e3b88f84-8637-4b0e-b9de-fa1890fd8634): created successfully Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed47f8d4-f995-4415-aa71-5a10fd06f5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Flow 'volume_create_manager' (2b5b268d-f1f3-47e4-8d97-954eb00bc86c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb5e654-f040-45e7-820a-abd5642adcfc]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:36 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-92ebfa4c-9075-431a-b7cd-873e5cf0164d tempest-CreateVolumesFromImageTest-483832763 None] Created volume successfully. Sep 17 15:15:36 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD Sep 17 15:15:36 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Flow 'volume_create_manager' (b8657a68-a975-418e-9609-418f6eb5535c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ab38bd-466a-4e5b-8842-702ff033c1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ab38bd-466a-4e5b-8842-702ff033c1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1517115369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283b74a1-5573-4eb2-8e97-ebc3f04acfbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c18099c77804f389961048c932e3afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:37Z,use_quota=True,user_id='f582d655c48d42af88baca1cead70409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d80576-cd0e-4b75-8cea-0388fb9ca62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29d80576-cd0e-4b75-8cea-0388fb9ca62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b062246-b73b-4027-9412-904c00159ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b062246-b73b-4027-9412-904c00159ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '283b74a1-5573-4eb2-8e97-ebc3f04acfbb', 'volume_name': 'volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28cb1b33-3079-45ef-90c3-4ab86548567a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28cb1b33-3079-45ef-90c3-4ab86548567a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b32f6e3-d257-4c07-b56b-3106996753cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:36 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Volume 283b74a1-5573-4eb2-8e97-ebc3f04acfbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb', 'volume_size': 1} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:36 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:36 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58 1073741824" returned: 0 in 0.510s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:36 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58 Sep 17 15:15:36 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:36 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD Sep 17 15:15:36 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:37 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58" returned: 0 in 0.261s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.923s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1009502348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b07aa0-1503-495c-8043-87896711167f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74b8af40c34948a63448a5664c52a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:34Z,use_quota=True,user_id='947f374435de4ea19e01ee3000ee0e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Creating volume c8b07aa0-1503-495c-8043-87896711167f {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:37 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c8b07aa0-1503-495c-8043-87896711167f 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:37 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Temporary image d0193bdd-3daf-418f-b5fe-4d7634dcd9d3 is fetched for user 86c3fd590d5446649d1f74ecbb43a119. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 15:15:37 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c8b07aa0-1503-495c-8043-87896711167f 1073741824 Sep 17 15:15:37 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61f62abe-871a-4cab-91cf-a69e8dfbb0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff37b987-411e-4858-9332-25e1eb443450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:37 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Volume volume-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58 (1d5e14ec-9410-497b-bbb6-6ce8e07bbd58): created successfully Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff37b987-411e-4858-9332-25e1eb443450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Flow 'volume_create_manager' (955ac374-ccb2-4b3d-ae30-c0e585a00a8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a33b6f0-7e0c-4505-b83a-57e16e81a23f]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "cinder-e3b88f84-8637-4b0e-b9de-fa1890fd8634-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fa3855dc-6759-4076-a27f-a9cfda464b56 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Created volume successfully. Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-e3b88f84-8637-4b0e-b9de-fa1890fd8634-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "cinder-quobyte-e3b88f84-8637-4b0e-b9de-fa1890fd8634" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-quobyte-e3b88f84-8637-4b0e-b9de-fa1890fd8634" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[634eaee6-342f-4979-83a7-27bf8a4d5730]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3b88f84-8637-4b0e-b9de-fa1890fd8634 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:37 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:37 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD Sep 17 15:15:37 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c8b07aa0-1503-495c-8043-87896711167f 1073741824" returned: 0 in 0.543s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c8b07aa0-1503-495c-8043-87896711167f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:37 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c8b07aa0-1503-495c-8043-87896711167f Sep 17 15:15:37 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:37 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3b88f84-8637-4b0e-b9de-fa1890fd8634 Sep 17 15:15:37 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:37 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:37 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c8b07aa0-1503-495c-8043-87896711167f" returned: 0 in 0.273s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.207s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-72989384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c843cde5-4698-40bc-bad5-68a71bed5666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74b8af40c34948a63448a5664c52a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:34Z,use_quota=True,user_id='947f374435de4ea19e01ee3000ee0e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Creating volume c843cde5-4698-40bc-bad5-68a71bed5666 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:37 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c843cde5-4698-40bc-bad5-68a71bed5666 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:37 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD Sep 17 15:15:37 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8fb957-9b33-443a-957f-8e83f47ae4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8b07aa0-1503-495c-8043-87896711167f', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:37 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c843cde5-4698-40bc-bad5-68a71bed5666 1073741824 Sep 17 15:15:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e018be-45b0-4a41-8a77-50e8e0133fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:37 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:38 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Volume volume-c8b07aa0-1503-495c-8043-87896711167f (c8b07aa0-1503-495c-8043-87896711167f): created successfully Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e018be-45b0-4a41-8a77-50e8e0133fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:38 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Flow 'volume_create_manager' (5ee4adce-22bc-4553-bcef-1a378477c504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3b88f84-8637-4b0e-b9de-fa1890fd8634" returned: 0 in 0.409s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3b88f84-8637-4b0e-b9de-fa1890fd8634 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:38 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-91a2fed5-bc44-470c-8f24-69df70e900dd tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Created volume successfully. Sep 17 15:15:38 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3b88f84-8637-4b0e-b9de-fa1890fd8634 Sep 17 15:15:38 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:38 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD" returned: 1 in 0.400s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:38 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e3b88f84-8637-4b0e-b9de-fa1890fd8634" returned: 0 in 0.265s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-quobyte-e3b88f84-8637-4b0e-b9de-fa1890fd8634" released by "delete_volume" :: held 0.724s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] Created reservations ['e143a777-e88c-4d40-92fd-8fd3dd92299e', '359fb224-8a6a-4622-a5e5-1d466fa98027', '7782f49d-3756-4445-a0cb-a1ee386675d7', 'd41ad5bc-07b0-4ac8-9985-e3cf6bb29f40'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:38 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c843cde5-4698-40bc-bad5-68a71bed5666 1073741824" returned: 0 in 0.493s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:38 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:15:38 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c843cde5-4698-40bc-bad5-68a71bed5666 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:38 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c843cde5-4698-40bc-bad5-68a71bed5666 Sep 17 15:15:38 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "cinder-40766573-3458-474e-956c-e8bdf7df2c60-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-40766573-3458-474e-956c-e8bdf7df2c60-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:38 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "cinder-quobyte-40766573-3458-474e-956c-e8bdf7df2c60" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.305s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:38 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] Deleted volume successfully. Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-quobyte-40766573-3458-474e-956c-e8bdf7df2c60" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-382f0c03-b653-409c-9a2e-c85ca5b1f541 tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-e3b88f84-8637-4b0e-b9de-fa1890fd8634-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2529f7-5fa7-4807-a084-3c2b3af10069]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40766573-3458-474e-956c-e8bdf7df2c60 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:38 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c843cde5-4698-40bc-bad5-68a71bed5666" returned: 0 in 0.319s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.255s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1412435959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b422b81-8f7f-4280-9127-dcd6c843d65f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74b8af40c34948a63448a5664c52a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:35Z,use_quota=True,user_id='947f374435de4ea19e01ee3000ee0e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Creating volume 4b422b81-8f7f-4280-9127-dcd6c843d65f {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:38 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4b422b81-8f7f-4280-9127-dcd6c843d65f 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:38 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4b422b81-8f7f-4280-9127-dcd6c843d65f 1073741824 Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56658158-f72a-44f8-92a6-c9f0c7abfea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c843cde5-4698-40bc-bad5-68a71bed5666', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:38 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d01566-bcc9-4d65-967c-93bad8052107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:38 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Volume volume-c843cde5-4698-40bc-bad5-68a71bed5666 (c843cde5-4698-40bc-bad5-68a71bed5666): created successfully Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d01566-bcc9-4d65-967c-93bad8052107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Flow 'volume_create_manager' (e9cd6fa2-9014-40eb-892a-9921e4b7cfe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:38 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b492dc30-d748-4828-b7fb-46c2f88a3386 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Created volume successfully. Sep 17 15:15:38 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40766573-3458-474e-956c-e8bdf7df2c60 Sep 17 15:15:38 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:39 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40766573-3458-474e-956c-e8bdf7df2c60" returned: 0 in 0.368s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40766573-3458-474e-956c-e8bdf7df2c60 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:39 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40766573-3458-474e-956c-e8bdf7df2c60 Sep 17 15:15:39 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:39 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4b422b81-8f7f-4280-9127-dcd6c843d65f 1073741824" returned: 0 in 0.446s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4b422b81-8f7f-4280-9127-dcd6c843d65f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:39 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4b422b81-8f7f-4280-9127-dcd6c843d65f Sep 17 15:15:39 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:39 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40766573-3458-474e-956c-e8bdf7df2c60" returned: 0 in 0.273s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-quobyte-40766573-3458-474e-956c-e8bdf7df2c60" released by "delete_volume" :: held 0.690s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] Created reservations ['7718c937-6a31-437c-8d38-2aaa8268130e', '52f2a53c-37a8-4f03-bdc6-6841d08a2bf3', 'f35c96a3-18e5-400a-b933-51c9e57c0c0a', 'f0e749ca-6a1e-485f-b2e0-7a9be496b78f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:39 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4b422b81-8f7f-4280-9127-dcd6c843d65f" returned: 0 in 0.262s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.784s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1298209964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdab8955-f716-421b-bbb1-9d9ac1e690fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f74b8af40c34948a63448a5664c52a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:36Z,use_quota=True,user_id='947f374435de4ea19e01ee3000ee0e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Creating volume cdab8955-f716-421b-bbb1-9d9ac1e690fe {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:39 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cdab8955-f716-421b-bbb1-9d9ac1e690fe 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:39 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cdab8955-f716-421b-bbb1-9d9ac1e690fe 1073741824 Sep 17 15:15:39 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458eb56d-290f-49af-94cf-feb81ea37459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b422b81-8f7f-4280-9127-dcd6c843d65f', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3efd36da-94c0-43d4-b77d-f1e46687768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:39 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:15:39 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:39 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Volume volume-4b422b81-8f7f-4280-9127-dcd6c843d65f (4b422b81-8f7f-4280-9127-dcd6c843d65f): created successfully Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3efd36da-94c0-43d4-b77d-f1e46687768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Flow 'volume_create_manager' (98b42e86-23af-4d7d-9768-e9b87b756caf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:39 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1e9e0df8-0d58-4084-804c-cd251f40e945 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Created volume successfully. Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "cinder-68bec70f-94e7-41fe-aa82-a67298a7b38e-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-68bec70f-94e7-41fe-aa82-a67298a7b38e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:39 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.312s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:39 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] Deleted volume successfully. Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "cinder-quobyte-68bec70f-94e7-41fe-aa82-a67298a7b38e" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f68ade43-81ef-4b32-bff7-e75f16958ea7 tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-40766573-3458-474e-956c-e8bdf7df2c60-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-quobyte-68bec70f-94e7-41fe-aa82-a67298a7b38e" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c55410-508b-4c69-ad6c-243f7923f5d4]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-68bec70f-94e7-41fe-aa82-a67298a7b38e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:40 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:40 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-68bec70f-94e7-41fe-aa82-a67298a7b38e Sep 17 15:15:40 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cdab8955-f716-421b-bbb1-9d9ac1e690fe 1073741824" returned: 0 in 0.528s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cdab8955-f716-421b-bbb1-9d9ac1e690fe {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:40 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cdab8955-f716-421b-bbb1-9d9ac1e690fe Sep 17 15:15:40 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:40 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:40 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cdab8955-f716-421b-bbb1-9d9ac1e690fe" returned: 0 in 0.249s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.654s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1517115369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283b74a1-5573-4eb2-8e97-ebc3f04acfbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c18099c77804f389961048c932e3afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:37Z,use_quota=True,user_id='f582d655c48d42af88baca1cead70409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Creating volume 283b74a1-5573-4eb2-8e97-ebc3f04acfbb {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:40 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:40 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb 1073741824 Sep 17 15:15:40 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-68bec70f-94e7-41fe-aa82-a67298a7b38e" returned: 0 in 0.455s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-68bec70f-94e7-41fe-aa82-a67298a7b38e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:40 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:15:40 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e46e149-94b6-4904-b0df-4a93f88bbf1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdab8955-f716-421b-bbb1-9d9ac1e690fe', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4554a6-c4ba-43a2-9c6a-347741437eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:40 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-68bec70f-94e7-41fe-aa82-a67298a7b38e Sep 17 15:15:40 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:40 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Volume volume-cdab8955-f716-421b-bbb1-9d9ac1e690fe (cdab8955-f716-421b-bbb1-9d9ac1e690fe): created successfully Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4554a6-c4ba-43a2-9c6a-347741437eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Flow 'volume_create_manager' (d6a53b3a-8e1f-4f2e-9404-f48b0225c6bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:40 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9c634b96-41f3-40a3-94f2-48e456958ef0 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Created volume successfully. Sep 17 15:15:40 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.296s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:15:40 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-68bec70f-94e7-41fe-aa82-a67298a7b38e" returned: 0 in 0.335s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-quobyte-68bec70f-94e7-41fe-aa82-a67298a7b38e" released by "delete_volume" :: held 0.840s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] Created reservations ['af985135-fe88-4cb1-ba65-8b79d2f94058', 'f156f9ff-c662-44b0-855f-1471a1aa810f', 'cd37ffec-7c4d-41d1-bf25-da08df8e3a70', '74aee079-a1c9-4ebb-ad0b-c7cefcdbafdb'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:40 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "cinder-cdab8955-f716-421b-bbb1-9d9ac1e690fe-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb 1073741824" returned: 0 in 0.577s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:40 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:15:40 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-cdab8955-f716-421b-bbb1-9d9ac1e690fe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "cinder-quobyte-cdab8955-f716-421b-bbb1-9d9ac1e690fe" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-quobyte-cdab8955-f716-421b-bbb1-9d9ac1e690fe" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:41 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb Sep 17 15:15:41 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "cinder-53be934b-70fe-4cb2-b377-201f158aeb62-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e8bdc6-2f20-4184-b6e4-fcd2e9f95342]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-53be934b-70fe-4cb2-b377-201f158aeb62-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cdab8955-f716-421b-bbb1-9d9ac1e690fe {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "cinder-quobyte-53be934b-70fe-4cb2-b377-201f158aeb62" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-quobyte-53be934b-70fe-4cb2-b377-201f158aeb62" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8a5a05-5075-44b5-9bb8-b2d7b287c500]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53be934b-70fe-4cb2-b377-201f158aeb62 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:41 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cdab8955-f716-421b-bbb1-9d9ac1e690fe Sep 17 15:15:41 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:41 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.345s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] Deleted volume successfully. Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8dd77cde-9433-494c-820f-26b32739dd12 tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-68bec70f-94e7-41fe-aa82-a67298a7b38e-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:41 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb" returned: 0 in 0.322s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.130s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31886b78-b72e-4b8a-a926-6c764b03f79f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9db3254442bd448f891200c52e5434bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:36Z,use_quota=True,user_id='86c3fd590d5446649d1f74ecbb43a119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e3d212f-9151-486b-a694-f8440eda3383),volume_type_id=9e3d212f-9151-486b-a694-f8440eda3383)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Creating volume 31886b78-b72e-4b8a-a926-6c764b03f79f {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:41 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b32f6e3-d257-4c07-b56b-3106996753cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:41 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53be934b-70fe-4cb2-b377-201f158aeb62 Sep 17 15:15:41 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3895aa-018f-4d6f-b0a2-242cf532ef38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:41 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f 1073741824 Sep 17 15:15:41 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:41 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Volume volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb (283b74a1-5573-4eb2-8e97-ebc3f04acfbb): created successfully Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3895aa-018f-4d6f-b0a2-242cf532ef38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Flow 'volume_create_manager' (b8657a68-a975-418e-9609-418f6eb5535c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4f904d08-bf7b-461a-be19-f63c7caaa4fe tempest-ProjectReaderTests-1757589202 None] Created volume successfully. Sep 17 15:15:41 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cdab8955-f716-421b-bbb1-9d9ac1e690fe" returned: 0 in 0.452s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cdab8955-f716-421b-bbb1-9d9ac1e690fe {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:41 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cdab8955-f716-421b-bbb1-9d9ac1e690fe Sep 17 15:15:41 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:41 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53be934b-70fe-4cb2-b377-201f158aeb62" returned: 0 in 0.422s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53be934b-70fe-4cb2-b377-201f158aeb62 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:41 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53be934b-70fe-4cb2-b377-201f158aeb62 Sep 17 15:15:41 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:41 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cdab8955-f716-421b-bbb1-9d9ac1e690fe" returned: 0 in 0.272s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-quobyte-cdab8955-f716-421b-bbb1-9d9ac1e690fe" released by "delete_volume" :: held 0.807s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:41 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f 1073741824" returned: 0 in 0.517s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:41 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Created reservations ['bd35a3fd-9779-4167-ad25-269b5884788e', '57c06f5d-d931-4f10-a014-9be9b73be3bb', '60254dde-fd39-45ff-88d1-4d4bd8d3b770', '92d1b62b-a2e4-4be6-977d-b801c7118422'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:41 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f Sep 17 15:15:41 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:41 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53be934b-70fe-4cb2-b377-201f158aeb62" returned: 0 in 0.296s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-quobyte-53be934b-70fe-4cb2-b377-201f158aeb62" released by "delete_volume" :: held 0.774s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] Created reservations ['f1cb5298-7a87-437b-bd80-75c1f90450d7', '7b7340ec-961b-4995-ab40-73a0b6870531', '60665718-90b4-49f6-99fb-a792253e19ad', 'fdc2e9b1-63bd-42dc-8b60-65e3386b5997'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:42 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:15:42 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "cinder-4b422b81-8f7f-4280-9127-dcd6c843d65f-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-4b422b81-8f7f-4280-9127-dcd6c843d65f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "cinder-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:42 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:15:42 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "cinder-quobyte-4b422b81-8f7f-4280-9127-dcd6c843d65f" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:42 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f" returned: 0 in 0.436s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-quobyte-4b422b81-8f7f-4280-9127-dcd6c843d65f" acquired by "delete_volume" :: waited 0.047s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.132s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5198b175-254a-4b3e-b001-5780079e9172]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4b422b81-8f7f-4280-9127-dcd6c843d65f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "cinder-quobyte-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] Creating offline snapshot 24e71950-643e-4676-a2fe-9e4eb5372d4b of volume 283b74a1-5573-4eb2-8e97-ebc3f04acfbb {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Attempting download of d0193bdd-3daf-418f-b5fe-4d7634dcd9d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/d0193bdd-3daf-418f-b5fe-4d7634dcd9d3', 'metadata': {}}])) to volume 31886b78-b72e-4b8a-a926-6c764b03f79f. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0efe9e-507b-4091-9dc9-b26f5be64474]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-quobyte-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0" acquired by "delete_volume" :: waited 0.075s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37bb6ac-36fe-47b2-82b9-80ac37fc7ac7]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:42 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:42 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4b422b81-8f7f-4280-9127-dcd6c843d65f Sep 17 15:15:42 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7cd132-79a8-48d6-ad74-e0837dfeca50]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_6vww9c1i {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.552s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:42 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Deleted volume successfully. Sep 17 15:15:42 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-31307b43-4a49-4da8-8239-ca2cf9e2c085 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-cdab8955-f716-421b-bbb1-9d9ac1e690fe-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:42 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb Sep 17 15:15:42 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.412s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:42 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] Deleted volume successfully. Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-421fc0a9-a320-4cb2-a38d-ad710f3d6c10 tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-53be934b-70fe-4cb2-b377-201f158aeb62-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:42 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0 Sep 17 15:15:42 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:42 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_6vww9c1i Sep 17 15:15:42 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:42 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4b422b81-8f7f-4280-9127-dcd6c843d65f" returned: 0 in 0.484s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4b422b81-8f7f-4280-9127-dcd6c843d65f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:42 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4b422b81-8f7f-4280-9127-dcd6c843d65f Sep 17 15:15:42 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:43 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:43 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb" returned: 0 in 0.532s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_6vww9c1i" returned: 0 in 0.440s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_6vww9c1i {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:43 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:43 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b 1G Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0" returned: 0 in 0.492s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:43 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:43 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0 Sep 17 15:15:43 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:43 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_6vww9c1i Sep 17 15:15:43 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:43 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4b422b81-8f7f-4280-9127-dcd6c843d65f" returned: 0 in 0.293s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-quobyte-4b422b81-8f7f-4280-9127-dcd6c843d65f" released by "delete_volume" :: held 0.866s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Created reservations ['89b1aaf2-e1b4-4408-a2dc-388eb985e8f5', '456a0e2a-eb85-48fa-a561-5b9b59ddc167', '9b87cb41-c98f-4ce5-a087-547dacba19a6', '5064be1b-6405-476e-b617-c17519730e4c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:43 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0" returned: 0 in 0.348s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:43 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:15:43 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "cinder-c843cde5-4698-40bc-bad5-68a71bed5666-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-quobyte-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0" released by "delete_volume" :: held 0.938s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:43 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_6vww9c1i" returned: 1 in 0.443s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_6vww9c1i' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b84387a-6f96-4d3d-85d6-63b271bc9f27]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-c843cde5-4698-40bc-bad5-68a71bed5666-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "cinder-quobyte-c843cde5-4698-40bc-bad5-68a71bed5666" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] Created reservations ['d4771115-fde5-44f6-b3ce-7a137e812e01', '8e579ee4-8148-4cc3-b9f7-c094f17c7136', '4016c699-90bf-4d6a-9105-2aae07f1a4db', '81dcb590-0a14-4ec2-9900-a0c5714be153'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-quobyte-c843cde5-4698-40bc-bad5-68a71bed5666" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:43 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:43 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD Sep 17 15:15:43 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b 1G" returned: 0 in 0.642s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f585ebde-a819-4418-aa6a-d3656eb0a2d2]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c843cde5-4698-40bc-bad5-68a71bed5666 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:43 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b Sep 17 15:15:43 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:43 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.380s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:43 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Deleted volume successfully. Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0ba46e95-529e-4b59-a9cc-28b68804b042 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-4b422b81-8f7f-4280-9127-dcd6c843d65f-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:43 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:15:43 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:43 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c843cde5-4698-40bc-bad5-68a71bed5666 Sep 17 15:15:43 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:43 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:44 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b" returned: 0 in 0.373s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:44 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b is being set with open permissions: ugo+rw Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:44 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD Sep 17 15:15:44 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:44 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b Sep 17 15:15:44 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:44 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.305s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] Deleted volume successfully. Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe2a39a5-2226-4e0a-ac9f-717f388cf07f tempest-CreateVolumesFromImageTest-483832763 None] Lock "cinder-bd2a4ad2-24a9-4476-a15d-1ea3d5b7c7f0-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:44 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c843cde5-4698-40bc-bad5-68a71bed5666" returned: 0 in 0.481s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c843cde5-4698-40bc-bad5-68a71bed5666 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:44 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c843cde5-4698-40bc-bad5-68a71bed5666 Sep 17 15:15:44 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:44 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:44 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b" returned: 0 in 0.278s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD" returned: 1 in 0.398s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] d0193bdd-3daf-418f-b5fe-4d7634dcd9d3 was raw, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:44 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f Sep 17 15:15:44 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:44 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.info Sep 17 15:15:44 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:44 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c843cde5-4698-40bc-bad5-68a71bed5666" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-quobyte-c843cde5-4698-40bc-bad5-68a71bed5666" released by "delete_volume" :: held 0.820s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Created reservations ['aa468d7a-7c3b-417d-92e4-353f68ac40ea', 'a46d2459-a91d-4fe1-b93b-feb02d1241de', '04c9c753-fbe8-42ae-959c-557d97cfe082', '9a7b47c7-6698-47d2-bab9-458744d79271'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:44 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:15:44 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:44 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.info" returned: 0 in 0.338s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:44 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.info is being set with open permissions: ugo+rw Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:44 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.info Sep 17 15:15:44 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "cinder-c8b07aa0-1503-495c-8043-87896711167f-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-c8b07aa0-1503-495c-8043-87896711167f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "cinder-quobyte-c8b07aa0-1503-495c-8043-87896711167f" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-quobyte-c8b07aa0-1503-495c-8043-87896711167f" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:45 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:45 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f" returned: 0 in 0.633s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.369s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d0193bdd-3daf-418f-b5fe-4d7634dcd9d3_x2xbni0jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:15:45 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Deleted volume successfully. Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0a9b35-48a7-490c-9e35-318cc899a15a]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c8b07aa0-1503-495c-8043-87896711167f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:45 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f 1G Sep 17 15:15:45 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-13715911-ede7-4ef5-b5f4-b3b3d989763e tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-c843cde5-4698-40bc-bad5-68a71bed5666-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:45 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c8b07aa0-1503-495c-8043-87896711167f Sep 17 15:15:45 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:45 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.info" returned: 0 in 0.430s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.801s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-04f94f2c-7f3e-4961-9998-c4c67da8c791 tempest-ProjectReaderTests-1757589202 None] Create snapshot completed successfully Sep 17 15:15:45 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f 1G" returned: 0 in 0.434s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Downloaded image d0193bdd-3daf-418f-b5fe-4d7634dcd9d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/d0193bdd-3daf-418f-b5fe-4d7634dcd9d3', 'metadata': {}}])) to volume 31886b78-b72e-4b8a-a926-6c764b03f79f successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Temporary image d0193bdd-3daf-418f-b5fe-4d7634dcd9d3 for user 86c3fd590d5446649d1f74ecbb43a119 is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Marking volume 31886b78-b72e-4b8a-a926-6c764b03f79f as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:15:45 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Copying metadata from image d0193bdd-3daf-418f-b5fe-4d7634dcd9d3 to 31886b78-b72e-4b8a-a926-6c764b03f79f. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Creating volume glance metadata for volume 31886b78-b72e-4b8a-a926-6c764b03f79f backed by image d0193bdd-3daf-418f-b5fe-4d7634dcd9d3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd0193bdd-3daf-418f-b5fe-4d7634dcd9d3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '57ad74c89d2c9e31b84314bec8917f4d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c8b07aa0-1503-495c-8043-87896711167f" returned: 0 in 0.434s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c8b07aa0-1503-495c-8043-87896711167f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:45 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c8b07aa0-1503-495c-8043-87896711167f Sep 17 15:15:45 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b963f3-914c-45f3-be64-e1de412e2b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31886b78-b72e-4b8a-a926-6c764b03f79f', 'volume_size': 1, 'image_id': 'd0193bdd-3daf-418f-b5fe-4d7634dcd9d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0193bdd-3daf-418f-b5fe-4d7634dcd9d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '57ad74c89d2c9e31b84314bec8917f4d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9db3254442bd448f891200c52e5434bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd5de737fd6d698db93fe6ded9598dc2ae2caac7c3ceb1ee6879111fe954078c74799eda9a44adfbede8d498b22022c3ee21a1ad13bf249f5a77a6f3fdd74c760', 'id': 'd0193bdd-3daf-418f-b5fe-4d7634dcd9d3', 'created_at': datetime.datetime(2026, 9, 17, 13, 15, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 15, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0193bdd-3daf-418f-b5fe-4d7634dcd9d3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ef8a31-cee9-4914-81fe-6a13d4279087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:45 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Volume volume-31886b78-b72e-4b8a-a926-6c764b03f79f (31886b78-b72e-4b8a-a926-6c764b03f79f): created successfully Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ef8a31-cee9-4914-81fe-6a13d4279087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Flow 'volume_create_manager' (ca8986a0-982d-414f-ae2a-8fb507fcf170) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b46745b6-d6d4-4f63-94ea-dc75428ab612 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Created volume successfully. Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-24e71950-643e-4676-a2fe-9e4eb5372d4b-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-24e71950-643e-4676-a2fe-9e4eb5372d4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-quobyte-283b74a1-5573-4eb2-8e97-ebc3f04acfbb" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-283b74a1-5573-4eb2-8e97-ebc3f04acfbb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-quobyte-24e71950-643e-4676-a2fe-9e4eb5372d4b" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-24e71950-643e-4676-a2fe-9e4eb5372d4b" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] Deleting offline snapshot 24e71950-643e-4676-a2fe-9e4eb5372d4b of volume 283b74a1-5573-4eb2-8e97-ebc3f04acfbb {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:15:45 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] snapshot_file for this snap is: volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-c8b07aa0-1503-495c-8043-87896711167f" returned: 0 in 0.394s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[265e6b5f-84a3-411a-b562-12dae0382c92]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-quobyte-c8b07aa0-1503-495c-8043-87896711167f" released by "delete_volume" :: held 0.924s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Acquiring lock "cinder-31886b78-b72e-4b8a-a926-6c764b03f79f-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Lock "cinder-31886b78-b72e-4b8a-a926-6c764b03f79f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Created reservations ['575aaf18-60f3-4e89-86af-550cce423576', '8e56554a-6b2c-4924-9a0e-009b9c44b282', '4b1129a0-afc9-4676-a2a4-96951074e566', 'd9ffeb34-88fe-4651-bd9c-16fc47022d43'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Acquiring lock "cinder-quobyte-31886b78-b72e-4b8a-a926-6c764b03f79f" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:46 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b Sep 17 15:15:46 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Lock "cinder-quobyte-31886b78-b72e-4b8a-a926-6c764b03f79f" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c1f6ed-43bd-47ab-855e-5f82d906bc39]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:46 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:15:46 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:46 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f Sep 17 15:15:46 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:46 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b" returned: 0 in 0.563s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f16247a-acd6-4eb4-aa93-df25bba89812]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:46 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f" returned: 0 in 0.441s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:46 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.403s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Deleted volume successfully. Sep 17 15:15:46 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f Sep 17 15:15:46 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-be58f465-87d9-43eb-ad78-88e3ae945198 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-c8b07aa0-1503-495c-8043-87896711167f-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:46 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb Sep 17 15:15:46 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:46 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-31886b78-b72e-4b8a-a926-6c764b03f79f" returned: 0 in 0.314s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Lock "cinder-quobyte-31886b78-b72e-4b8a-a926-6c764b03f79f" released by "delete_volume" :: held 0.812s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Created reservations ['9f2f95de-9af7-4767-89ef-9115fd9990e6', 'b7456606-0997-4ba4-bde6-efc814a7f642', 'd3a8f2d0-0b33-4761-bee5-0628b6f69f90', '0d71a4af-c251-4702-b39f-76316066c157'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:46 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb" returned: 0 in 0.458s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:47 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b Sep 17 15:15:47 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:47 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:15:47 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "cinder-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "cinder-quobyte-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-quobyte-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81f7037-a2ef-41f0-b53e-70fafbd3436f]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:47 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.335s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:47 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Deleted volume successfully. Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b4410a43-2df1-4203-ad0d-fcf1695759e3 tempest-VolumeAndVolumeTypeFromImageTest-245849813 None] Lock "cinder-31886b78-b72e-4b8a-a926-6c764b03f79f-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:47 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58 Sep 17 15:15:47 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:47 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b" returned: 0 in 0.629s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:47 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b Sep 17 15:15:47 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:47 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58" returned: 0 in 0.479s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:47 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58 Sep 17 15:15:47 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:47 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb.24e71950-643e-4676-a2fe-9e4eb5372d4b" returned: 0 in 0.341s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-24e71950-643e-4676-a2fe-9e4eb5372d4b" released by "_delete_snapshot" :: held 2.155s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-283b74a1-5573-4eb2-8e97-ebc3f04acfbb" released by "delete_snapshot" :: held 2.212s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] Created reservations ['03a86bc1-6181-4d57-8ead-617d6b45149b', '11ff44b7-2c3a-4ac3-b564-bc4c03089e0d', '36bde0bd-b0bc-4e08-af31-6101ec1b30cf', '55bd84d1-ea20-4133-92fd-139151859629'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:48 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58" returned: 0 in 0.345s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-quobyte-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58" released by "delete_volume" :: held 0.912s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:48 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] Delete snapshot completed successfully. Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-46a5c1b8-33fd-4f1b-b98b-dcb069265696 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-24e71950-643e-4676-a2fe-9e4eb5372d4b-delete_snapshot" released by "delete_snapshot" :: held 2.420s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Created reservations ['ed1c030f-d102-4652-9d1b-17117fe3f545', 'e385f44b-bb8c-4029-8a1b-bb1e5dd6564a', 'f2b06680-701e-4b6d-b5a1-db8227de30d7', '22559524-b513-4340-af73-538b1eacf984'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:48 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:15:48 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "cinder-56c900e8-39ec-44f6-a2bc-1a68eea45c63-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-56c900e8-39ec-44f6-a2bc-1a68eea45c63-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "cinder-quobyte-56c900e8-39ec-44f6-a2bc-1a68eea45c63" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-quobyte-56c900e8-39ec-44f6-a2bc-1a68eea45c63" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[06defc5e-d817-4b0b-9083-b1d85a7edf05]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56c900e8-39ec-44f6-a2bc-1a68eea45c63 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:48 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.356s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:48 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Deleted volume successfully. Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e1c43ba5-4ad7-49cd-a2a3-79f2df524b49 tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-1d5e14ec-9410-497b-bbb6-6ce8e07bbd58-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:48 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56c900e8-39ec-44f6-a2bc-1a68eea45c63 Sep 17 15:15:48 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-283b74a1-5573-4eb2-8e97-ebc3f04acfbb-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-283b74a1-5573-4eb2-8e97-ebc3f04acfbb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Flow 'volume_create_manager' (75835d0f-844a-45b7-8c97-3684634742d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e106fa-708b-4cd1-89ce-630a654b4985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e106fa-708b-4cd1-89ce-630a654b4985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-750501468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ee8a17-90e1-434d-a15b-5df5ecdb68ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebcd083a65f48ff98189019f1302606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:49Z,use_quota=True,user_id='965bdb87a463494981d079ed966991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae21612b-5a28-4f88-b993-50fd42ee82eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae21612b-5a28-4f88-b993-50fd42ee82eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49979b34-8777-40d7-8ae7-a6185a46b2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49979b34-8777-40d7-8ae7-a6185a46b2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ee8a17-90e1-434d-a15b-5df5ecdb68ea', 'volume_name': 'volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020fa46b-45cd-4c39-88a1-90145fcb0955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020fa46b-45cd-4c39-88a1-90145fcb0955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:49 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7190f4f2-19e7-4bf3-a251-eb51643bfb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:49 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Volume 15ee8a17-90e1-434d-a15b-5df5ecdb68ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea', 'volume_size': 1} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-750501468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ee8a17-90e1-434d-a15b-5df5ecdb68ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebcd083a65f48ff98189019f1302606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:49Z,use_quota=True,user_id='965bdb87a463494981d079ed966991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Creating volume 15ee8a17-90e1-434d-a15b-5df5ecdb68ea {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:49 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56c900e8-39ec-44f6-a2bc-1a68eea45c63" returned: 0 in 0.546s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56c900e8-39ec-44f6-a2bc-1a68eea45c63 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:49 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea 1073741824 Sep 17 15:15:49 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-quobyte-283b74a1-5573-4eb2-8e97-ebc3f04acfbb" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:49 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56c900e8-39ec-44f6-a2bc-1a68eea45c63 Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-283b74a1-5573-4eb2-8e97-ebc3f04acfbb" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:49 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f0cc67-010d-4c12-b2f2-f33f4066ee41]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:49 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb Sep 17 15:15:49 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:49 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-56c900e8-39ec-44f6-a2bc-1a68eea45c63" returned: 0 in 0.319s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-quobyte-56c900e8-39ec-44f6-a2bc-1a68eea45c63" released by "delete_volume" :: held 0.934s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Created reservations ['040165c8-0e7e-453d-98b5-a50d38a9f6bf', '19340fe4-acb0-4d66-940f-75323525c26e', '73980092-b94d-475f-b9bd-20774ced91ae', 'dd1c7d89-4113-42cd-a82b-7662fc65a24c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:49 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea 1073741824" returned: 0 in 0.591s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:49 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:15:49 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:49 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb" returned: 0 in 0.541s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:49 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea Sep 17 15:15:49 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:49 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb Sep 17 15:15:49 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:50 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.338s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Deleted volume successfully. Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1b52e09-1fd7-48b5-8ee4-e8fe1e00e0ec tempest-CreateVolumesFromSourceVolumeTest-939041350 None] Lock "cinder-56c900e8-39ec-44f6-a2bc-1a68eea45c63-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:50 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea" returned: 0 in 0.318s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7190f4f2-19e7-4bf3-a251-eb51643bfb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (750237b3-1ca9-47bf-b1df-e094fbcf1588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:50 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Volume volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea (15ee8a17-90e1-434d-a15b-5df5ecdb68ea): created successfully Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (750237b3-1ca9-47bf-b1df-e094fbcf1588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Flow 'volume_create_manager' (75835d0f-844a-45b7-8c97-3684634742d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d05c2804-94f7-4a3e-8201-5a72e3c65110 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Created volume successfully. Sep 17 15:15:50 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-283b74a1-5573-4eb2-8e97-ebc3f04acfbb" returned: 0 in 0.373s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-283b74a1-5573-4eb2-8e97-ebc3f04acfbb" released by "delete_volume" :: held 0.996s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] Created reservations ['f146a634-b3da-47c7-9e9f-d1cb01dd941a', '74a9d95c-9f32-4855-b8da-0e89a9f753ea', '31871759-a8c0-4823-9384-373c58c58f83', 'd7873510-64ee-472d-af86-3402f8bc466b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:50 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:15:50 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:50 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.261s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] Deleted volume successfully. Sep 17 15:15:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-73296f3d-faa2-47b5-85f5-3d3446edfd70 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-283b74a1-5573-4eb2-8e97-ebc3f04acfbb-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Creating offline snapshot b5b6da34-9a0a-493a-8038-337525ec39e9 of volume 15ee8a17-90e1-434d-a15b-5df5ecdb68ea {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:15:51 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bd7369-ae14-4c99-be72-b7472bdb90d6]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:51 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea Sep 17 15:15:51 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:51 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:51 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Flow 'volume_create_manager' (67a0917b-f0ce-467f-b41b-e57f0a205f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e70d4ad-d5cc-40ae-b7fa-57686308732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea" returned: 0 in 0.562s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e70d4ad-d5cc-40ae-b7fa-57686308732b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1257973413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b7372a-b88d-44b6-b53f-bd9ca63ff252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c18099c77804f389961048c932e3afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:52Z,use_quota=True,user_id='f582d655c48d42af88baca1cead70409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:51 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9 1G Sep 17 15:15:51 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b672952-a545-4c3c-8a17-f4d0f896492c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b672952-a545-4c3c-8a17-f4d0f896492c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d250ea2a-986c-4c5b-9c37-d15b87fc5463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d250ea2a-986c-4c5b-9c37-d15b87fc5463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53b7372a-b88d-44b6-b53f-bd9ca63ff252', 'volume_name': 'volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca79fdd-d1c7-4ecc-8974-fb41597b350a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca79fdd-d1c7-4ecc-8974-fb41597b350a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795fb735-ca37-4da1-bd70-11232023743c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:52 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Volume 53b7372a-b88d-44b6-b53f-bd9ca63ff252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252', 'volume_size': 1} Sep 17 15:15:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:52 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9 1G" returned: 0 in 0.502s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:52 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9 Sep 17 15:15:52 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:52 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9" returned: 0 in 0.330s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:52 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9 is being set with open permissions: ugo+rw Sep 17 15:15:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:52 devstack sudo[105717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9 Sep 17 15:15:52 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:53 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9" returned: 0 in 0.278s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:53 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.info Sep 17 15:15:53 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:53 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.info" returned: 0 in 0.318s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:53 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.info is being set with open permissions: ugo+rw Sep 17 15:15:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:53 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.info Sep 17 15:15:53 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:53 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.info" returned: 0 in 0.304s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.421s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.742s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1257973413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b7372a-b88d-44b6-b53f-bd9ca63ff252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c18099c77804f389961048c932e3afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:52Z,use_quota=True,user_id='f582d655c48d42af88baca1cead70409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Creating volume 53b7372a-b88d-44b6-b53f-bd9ca63ff252 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:53 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:53 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252 1073741824 Sep 17 15:15:53 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-42285a4f-0d45-4d89-8828-838f9bf55b77 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Create snapshot completed successfully Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Flow 'volume_create_manager' (c6a42bfb-1c59-48e1-a77a-65c70cb8fb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6af3a4-d461-4d7d-ab1a-eb00c2f76647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6af3a4-d461-4d7d-ab1a-eb00c2f76647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-144039779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea28cfe-2843-4d8f-8580-e4eb57335567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5e9b1a432a4beaa25a8fbce51191db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:54Z,use_quota=True,user_id='cb762788d0c746ba96ac633cc4c680b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7b2bafd-aba2-45f7-8602-a6591b898218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7b2bafd-aba2-45f7-8602-a6591b898218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d21849-385f-436c-a6c6-8ca4e97c9a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7d21849-385f-436c-a6c6-8ca4e97c9a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cea28cfe-2843-4d8f-8580-e4eb57335567', 'volume_name': 'volume-cea28cfe-2843-4d8f-8580-e4eb57335567', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d185534f-35e3-404b-af0f-ac6d388f3705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d185534f-35e3-404b-af0f-ac6d388f3705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167fd249-18f9-4566-b938-d39ac4b8d7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:54 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Volume cea28cfe-2843-4d8f-8580-e4eb57335567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cea28cfe-2843-4d8f-8580-e4eb57335567', 'volume_size': 1} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:54 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252 1073741824" returned: 0 in 0.534s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:54 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252 Sep 17 15:15:54 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:54 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252" returned: 0 in 0.270s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.333s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-144039779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea28cfe-2843-4d8f-8580-e4eb57335567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5e9b1a432a4beaa25a8fbce51191db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:54Z,use_quota=True,user_id='cb762788d0c746ba96ac633cc4c680b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Creating volume cea28cfe-2843-4d8f-8580-e4eb57335567 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:54 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:54 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 1073741824 Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795fb735-ca37-4da1-bd70-11232023743c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:54 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d99357a-1413-49ae-b159-21bc2b69f052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:54 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Volume volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252 (53b7372a-b88d-44b6-b53f-bd9ca63ff252): created successfully Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d99357a-1413-49ae-b159-21bc2b69f052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Flow 'volume_create_manager' (67a0917b-f0ce-467f-b41b-e57f0a205f6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:54 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-91c00b50-216f-495e-855b-c5a94bf29513 tempest-ProjectReaderTests-1757589202 None] Created volume successfully. Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Flow 'volume_create_manager' (aa07d986-4bc9-4654-a688-53aa243f7ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c136b89-fddd-47cc-abe8-472490cb11a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c136b89-fddd-47cc-abe8-472490cb11a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1138812293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebcd083a65f48ff98189019f1302606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:55Z,use_quota=True,user_id='965bdb87a463494981d079ed966991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa1d8d4d-35dc-4ef4-9580-1795c1d160af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa1d8d4d-35dc-4ef4-9580-1795c1d160af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87da2242-1e9a-4c75-b754-bc43a6becf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87da2242-1e9a-4c75-b754-bc43a6becf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec', 'volume_name': 'volume-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553bc9aa-2096-4f43-964f-2de8e0f059f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553bc9aa-2096-4f43-964f-2de8e0f059f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88fbd52e-c4cb-4ced-bc76-a2a6e4417d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:55 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Volume fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec', 'volume_size': 1} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:55 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 1073741824" returned: 0 in 0.554s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:55 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 Sep 17 15:15:55 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:55 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567" returned: 0 in 0.355s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.452s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1138812293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebcd083a65f48ff98189019f1302606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:55Z,use_quota=True,user_id='965bdb87a463494981d079ed966991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Creating volume fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:55 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:55 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec 1073741824 Sep 17 15:15:55 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167fd249-18f9-4566-b938-d39ac4b8d7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea28cfe-2843-4d8f-8580-e4eb57335567', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa5599a-1299-41ab-86e7-348f781465d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:55 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Volume volume-cea28cfe-2843-4d8f-8580-e4eb57335567 (cea28cfe-2843-4d8f-8580-e4eb57335567): created successfully Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa5599a-1299-41ab-86e7-348f781465d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Flow 'volume_create_manager' (c6a42bfb-1c59-48e1-a77a-65c70cb8fb20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Flow 'volume_create_manager' (1da9d1b4-b1aa-442e-b690-7e48ed657720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cc9e0a3-150c-4eed-9161-b3f1e70e4ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-aa2bec0e-ddf1-455e-8de4-ab027d3bffbd tempest-VolumeDependencyTests-2111340249 None] Created volume successfully. Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cc9e0a3-150c-4eed-9161-b3f1e70e4ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1038997303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3baff944-e236-4148-807a-7a4c1a940737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebcd083a65f48ff98189019f1302606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:56Z,use_quota=True,user_id='965bdb87a463494981d079ed966991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63bddbb3-252e-4341-a526-6c46e26f7b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63bddbb3-252e-4341-a526-6c46e26f7b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62528989-eb7b-43c0-b141-ceb639a8094e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62528989-eb7b-43c0-b141-ceb639a8094e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3baff944-e236-4148-807a-7a4c1a940737', 'volume_name': 'volume-3baff944-e236-4148-807a-7a4c1a940737', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c49494-610d-4b52-8fba-2fb2568c4056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c49494-610d-4b52-8fba-2fb2568c4056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d8af65-5c90-4e7b-8bd9-2efc6b6f0bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:55 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Volume 3baff944-e236-4148-807a-7a4c1a940737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3baff944-e236-4148-807a-7a4c1a940737', 'volume_size': 1} Sep 17 15:15:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Flow 'volume_create_manager' (ad4c0813-c744-49ee-9790-8e3c61354808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1629763f-594f-4981-a090-ded469bb5da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1629763f-594f-4981-a090-ded469bb5da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb0ba531-39a1-4176-af34-046b788d4cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef9f070a9b64afb9c09df771b7feba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:56Z,use_quota=True,user_id='cbf53ab463304247a07299b0fad2dcd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb0437a-5f49-4890-b229-c724284a8857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb0437a-5f49-4890-b229-c724284a8857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c28388f-1532-430f-b42e-90060152f5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:15:56 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Flow 'volume_create_manager' (603fae60-250a-4a2d-b6e7-933475f91bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6289b3-c790-4088-83af-55cecf41b7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec 1073741824" returned: 0 in 0.711s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6289b3-c790-4088-83af-55cecf41b7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-90524989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f2e90f-4835-4e17-9ddd-f92cf92da54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebcd083a65f48ff98189019f1302606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:56Z,use_quota=True,user_id='965bdb87a463494981d079ed966991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6a08ba-cb9d-4ffa-9a63-7681dcf3e994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6a08ba-cb9d-4ffa-9a63-7681dcf3e994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba999e4a-5064-4352-85e9-b9d674c96ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba999e4a-5064-4352-85e9-b9d674c96ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5f2e90f-4835-4e17-9ddd-f92cf92da54d', 'volume_name': 'volume-d5f2e90f-4835-4e17-9ddd-f92cf92da54d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ceda3f-291a-4801-9acd-763eaa689520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ceda3f-291a-4801-9acd-763eaa689520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39eba23e-aada-4018-a63f-c20517682acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:56 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Volume d5f2e90f-4835-4e17-9ddd-f92cf92da54d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5f2e90f-4835-4e17-9ddd-f92cf92da54d', 'volume_size': 1} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:56 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec Sep 17 15:15:56 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Flow 'volume_create_manager' (fc8d583a-9da4-4f21-81fb-d206c50218af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd92888-b6be-48c8-8e15-f319198c17f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd92888-b6be-48c8-8e15-f319198c17f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1025691148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5163db1e-dca8-4da1-8825-29b73dde9c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebcd083a65f48ff98189019f1302606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:56Z,use_quota=True,user_id='965bdb87a463494981d079ed966991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97073506-00d4-459f-9a68-2b312ea6b437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97073506-00d4-459f-9a68-2b312ea6b437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23fbf8ac-f639-49fa-a516-e1812f7d8ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23fbf8ac-f639-49fa-a516-e1812f7d8ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5163db1e-dca8-4da1-8825-29b73dde9c74', 'volume_name': 'volume-5163db1e-dca8-4da1-8825-29b73dde9c74', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c5b4e8-a7ca-46df-a93b-f72f0a0a7835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c5b4e8-a7ca-46df-a93b-f72f0a0a7835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6e89f5-0b05-4f05-bb76-55daa174318a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:56 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Volume 5163db1e-dca8-4da1-8825-29b73dde9c74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5163db1e-dca8-4da1-8825-29b73dde9c74', 'volume_size': 1} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c28388f-1532-430f-b42e-90060152f5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fb0ba531-39a1-4176-af34-046b788d4cff', 'volume_name': 'volume-fb0ba531-39a1-4176-af34-046b788d4cff', 'volume_size': 1, 'image_id': 'ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd2a9396886f0818f67ad87b89d8b759c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1ef9f070a9b64afb9c09df771b7feba4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e110f9640a690f8b7e3ec74fa661a76a22cfb94e3394e4140ddf26a290fac498214e67e68d363165974023a1c24149889439f0af11181e5402044340f7e01521', 'id': 'ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8', 'created_at': datetime.datetime(2026, 9, 17, 13, 15, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 15, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8/file', 'properties': {}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1caf919-a77e-4e10-93bf-c8da91a13b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1caf919-a77e-4e10-93bf-c8da91a13b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a82e34f-8593-45ac-ae2f-d197955251c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:56 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Volume fb0ba531-39a1-4176-af34-046b788d4cff: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fb0ba531-39a1-4176-af34-046b788d4cff', 'volume_size': 1, 'image_id': 'ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd2a9396886f0818f67ad87b89d8b759c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1ef9f070a9b64afb9c09df771b7feba4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e110f9640a690f8b7e3ec74fa661a76a22cfb94e3394e4140ddf26a290fac498214e67e68d363165974023a1c24149889439f0af11181e5402044340f7e01521', 'id': 'ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8', 'created_at': datetime.datetime(2026, 9, 17, 13, 15, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 15, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8/file', 'properties': {}}, 'image_service': } Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Trying to clone fb0ba531-39a1-4176-af34-046b788d4cff from image ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:15:56 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec" returned: 0 in 0.420s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1038997303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3baff944-e236-4148-807a-7a4c1a940737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebcd083a65f48ff98189019f1302606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:56Z,use_quota=True,user_id='965bdb87a463494981d079ed966991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Creating volume 3baff944-e236-4148-807a-7a4c1a940737 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:56 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3baff944-e236-4148-807a-7a4c1a940737 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 17 15:15:56 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Image download 0.00 MB at 0.00 MB/s Sep 17 15:15:56 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3baff944-e236-4148-807a-7a4c1a940737 1073741824 Sep 17 15:15:56 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88fbd52e-c4cb-4ced-bc76-a2a6e4417d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253a098a-aa42-46f4-b721-8df842ac49ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:56 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Volume volume-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec (fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec): created successfully Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253a098a-aa42-46f4-b721-8df842ac49ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Flow 'volume_create_manager' (aa07d986-4bc9-4654-a688-53aa243f7ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e8dfea-aaa0-41e2-8933-eb9c989f3c87]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0161e34a-ace6-422b-a371-ed724825fb19 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Created volume successfully. Sep 17 15:15:57 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD Sep 17 15:15:57 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Flow 'volume_create_manager' (088dd86f-289d-4874-b0f1-3fac5e28639d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deac1a56-b163-4189-9acf-a555df08eaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deac1a56-b163-4189-9acf-a555df08eaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-534967668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa93958a-2835-45b0-9f2a-8afd6fd8ead3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebcd083a65f48ff98189019f1302606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:57Z,use_quota=True,user_id='965bdb87a463494981d079ed966991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c25925f-5ee8-4bcb-9952-f9dd0652ed80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c25925f-5ee8-4bcb-9952-f9dd0652ed80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2acb0e2f-3573-44de-a7e4-4058192f1616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2acb0e2f-3573-44de-a7e4-4058192f1616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa93958a-2835-45b0-9f2a-8afd6fd8ead3', 'volume_name': 'volume-aa93958a-2835-45b0-9f2a-8afd6fd8ead3', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8803245c-e1fd-4fe4-b3b2-0c474c42bc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8803245c-e1fd-4fe4-b3b2-0c474c42bc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c9903c-56d5-42e3-a54a-42357789fce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:57 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Volume aa93958a-2835-45b0-9f2a-8afd6fd8ead3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa93958a-2835-45b0-9f2a-8afd6fd8ead3', 'volume_size': 1} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:57 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD" returned: 0 in 0.427s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:57 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3baff944-e236-4148-807a-7a4c1a940737 1073741824" returned: 0 in 0.553s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3baff944-e236-4148-807a-7a4c1a940737 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:57 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3baff944-e236-4148-807a-7a4c1a940737 Sep 17 15:15:57 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:57 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD Sep 17 15:15:57 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:57 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3baff944-e236-4148-807a-7a4c1a940737" returned: 0 in 0.260s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.700s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] Creating offline snapshot 5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733 of volume 53b7372a-b88d-44b6-b53f-bd9ca63ff252 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:15:57 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Temporary image ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8 is fetched for user cbf53ab463304247a07299b0fad2dcd8. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d8af65-5c90-4e7b-8bd9-2efc6b6f0bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3baff944-e236-4148-807a-7a4c1a940737', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a214974c-2890-4fd3-8080-7dbfc7e76923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[404e17d0-fe5e-45b9-b5b2-f53809bf0154]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:57 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Volume volume-3baff944-e236-4148-807a-7a4c1a940737 (3baff944-e236-4148-807a-7a4c1a940737): created successfully Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a214974c-2890-4fd3-8080-7dbfc7e76923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Flow 'volume_create_manager' (1da9d1b4-b1aa-442e-b690-7e48ed657720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b6905ec3-c64f-47d2-abd7-d3ab8f2b35f8 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Created volume successfully. Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfba506-b5f7-4f09-abe8-9e5953ffd403]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:57 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252 Sep 17 15:15:57 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:58 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD Sep 17 15:15:58 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:58 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252" returned: 0 in 0.419s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:58 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:58 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733 1G Sep 17 15:15:58 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:58 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD Sep 17 15:15:58 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:58 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD" returned: 1 in 0.327s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:15:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:58 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733 1G" returned: 0 in 0.411s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:58 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733 Sep 17 15:15:58 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:58 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733" returned: 0 in 0.296s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:58 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733 is being set with open permissions: ugo+rw Sep 17 15:15:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:58 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733 Sep 17 15:15:58 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:59 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733" returned: 0 in 0.252s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:59 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.info Sep 17 15:15:59 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:59 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.info" returned: 0 in 0.247s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:59 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.info is being set with open permissions: ugo+rw Sep 17 15:15:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:59 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.info Sep 17 15:15:59 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:59 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.info" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.966s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.327s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-90524989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f2e90f-4835-4e17-9ddd-f92cf92da54d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebcd083a65f48ff98189019f1302606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:56Z,use_quota=True,user_id='965bdb87a463494981d079ed966991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Creating volume d5f2e90f-4835-4e17-9ddd-f92cf92da54d {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:59 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:15:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d5f2e90f-4835-4e17-9ddd-f92cf92da54d 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:59 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d5f2e90f-4835-4e17-9ddd-f92cf92da54d 1073741824 Sep 17 15:15:59 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a852addb-3ebd-4da7-b218-cdb24a36a05b tempest-ProjectReaderTests-1757589202 None] Create snapshot completed successfully Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-quobyte-53b7372a-b88d-44b6-b53f-bd9ca63ff252" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-53b7372a-b88d-44b6-b53f-bd9ca63ff252" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-quobyte-5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] Deleting offline snapshot 5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733 of volume 53b7372a-b88d-44b6-b53f-bd9ca63ff252 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] snapshot_file for this snap is: volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a87145-bfdf-4c1d-98c0-d192d0df7bf9]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:00 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d5f2e90f-4835-4e17-9ddd-f92cf92da54d 1073741824" returned: 0 in 0.512s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d5f2e90f-4835-4e17-9ddd-f92cf92da54d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:00 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733 Sep 17 15:16:00 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:00 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d5f2e90f-4835-4e17-9ddd-f92cf92da54d Sep 17 15:16:00 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:00 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d5f2e90f-4835-4e17-9ddd-f92cf92da54d" returned: 0 in 0.259s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.807s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1025691148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5163db1e-dca8-4da1-8825-29b73dde9c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebcd083a65f48ff98189019f1302606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:56Z,use_quota=True,user_id='965bdb87a463494981d079ed966991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Creating volume 5163db1e-dca8-4da1-8825-29b73dde9c74 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:00 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5163db1e-dca8-4da1-8825-29b73dde9c74 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:00 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733" returned: 0 in 0.398s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:16:00 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5163db1e-dca8-4da1-8825-29b73dde9c74 1073741824 Sep 17 15:16:00 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39eba23e-aada-4018-a63f-c20517682acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5f2e90f-4835-4e17-9ddd-f92cf92da54d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7abab793-0b6d-4382-8877-a071dc3c89f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1396f592-d654-448c-be0b-dee88bfaa960]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:00 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Volume volume-d5f2e90f-4835-4e17-9ddd-f92cf92da54d (d5f2e90f-4835-4e17-9ddd-f92cf92da54d): created successfully Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7abab793-0b6d-4382-8877-a071dc3c89f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Flow 'volume_create_manager' (603fae60-250a-4a2d-b6e7-933475f91bbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-798b39b4-99b7-4c6f-8534-c7e034ac7221 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Created volume successfully. Sep 17 15:16:00 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252 Sep 17 15:16:00 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:00 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5163db1e-dca8-4da1-8825-29b73dde9c74 1073741824" returned: 0 in 0.418s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5163db1e-dca8-4da1-8825-29b73dde9c74 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:01 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5163db1e-dca8-4da1-8825-29b73dde9c74 Sep 17 15:16:01 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:01 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252" returned: 0 in 0.428s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:01 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733 Sep 17 15:16:01 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:01 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5163db1e-dca8-4da1-8825-29b73dde9c74" returned: 0 in 0.263s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.124s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f6e89f5-0b05-4f05-bb76-55daa174318a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5163db1e-dca8-4da1-8825-29b73dde9c74', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9055f450-7b2d-41a6-b479-a9f8a2009ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] Creating offline snapshot f0993d74-9a54-4395-9430-73e4a0205bd1 of volume cea28cfe-2843-4d8f-8580-e4eb57335567 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:16:01 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Volume volume-5163db1e-dca8-4da1-8825-29b73dde9c74 (5163db1e-dca8-4da1-8825-29b73dde9c74): created successfully Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9055f450-7b2d-41a6-b479-a9f8a2009ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Flow 'volume_create_manager' (fc8d583a-9da4-4f21-81fb-d206c50218af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfc92ea-f5b0-4607-83d6-02f673acd70e]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:01 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5bca5d95-f7f2-450f-9fd3-cd0243356534 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Created volume successfully. Sep 17 15:16:01 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733" returned: 0 in 0.389s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:01 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 Sep 17 15:16:01 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:01 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733 Sep 17 15:16:01 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:01 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:01 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567" returned: 0 in 0.385s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252.5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733" returned: 0 in 0.292s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:01 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1 1G Sep 17 15:16:01 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733" released by "_delete_snapshot" :: held 1.637s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-53b7372a-b88d-44b6-b53f-bd9ca63ff252" released by "delete_snapshot" :: held 1.672s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] Created reservations ['dd924891-e6cc-4f5f-921b-dcbe227a78ee', '1d5fdaba-4c93-480d-b59a-2363c1e5e920', '9dd83c17-e313-4b6b-bb85-fbfa5e64de29', 'd827a00a-4553-4cee-bbc3-0ead8b0ff339'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:01 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] Delete snapshot completed successfully. Sep 17 15:16:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ffe936a-3e1c-4d90-a943-5937e9f0a052 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-5bb319b2-0e9d-4ef2-8bde-4faf6ecd5733-delete_snapshot" released by "delete_snapshot" :: held 1.813s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:02 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1 1G" returned: 0 in 0.408s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cea28cfe-2843-4d8f-8580-e4eb57335567 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:02 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cea28cfe-2843-4d8f-8580-e4eb57335567 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1 Sep 17 15:16:02 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-53b7372a-b88d-44b6-b53f-bd9ca63ff252-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] Lock "cinder-53b7372a-b88d-44b6-b53f-bd9ca63ff252-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-quobyte-53b7372a-b88d-44b6-b53f-bd9ca63ff252" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-53b7372a-b88d-44b6-b53f-bd9ca63ff252" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:02 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[638ca308-fb32-470d-885a-58f623b383f4]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:02 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cea28cfe-2843-4d8f-8580-e4eb57335567 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1" returned: 0 in 0.333s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:02 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1 is being set with open permissions: ugo+rw Sep 17 15:16:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:02 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1 Sep 17 15:16:02 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:02 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252 Sep 17 15:16:02 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:02 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1" returned: 0 in 0.260s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:02 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.info Sep 17 15:16:02 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:02 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252" returned: 0 in 0.401s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:02 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252 Sep 17 15:16:02 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:03 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.info" returned: 0 in 0.267s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:03 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.info is being set with open permissions: ugo+rw Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:03 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-53b7372a-b88d-44b6-b53f-bd9ca63ff252" returned: 0 in 0.250s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:03 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.info Sep 17 15:16:03 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-53b7372a-b88d-44b6-b53f-bd9ca63ff252" released by "delete_volume" :: held 0.738s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] Created reservations ['f66ec006-e355-4676-9cc0-9bace8e40fb0', '96c877ed-a0a1-44ad-bafd-b44d4c33e5d3', '44a2a060-1fe3-4ec6-a223-900bb29c8286', 'e60ac0fa-ab1a-4056-ae05-68d02d9b338e'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:03 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:03 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:03 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.info" returned: 0 in 0.247s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.024s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-534967668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa93958a-2835-45b0-9f2a-8afd6fd8ead3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebcd083a65f48ff98189019f1302606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:57Z,use_quota=True,user_id='965bdb87a463494981d079ed966991d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Creating volume aa93958a-2835-45b0-9f2a-8afd6fd8ead3 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:03 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aa93958a-2835-45b0-9f2a-8afd6fd8ead3 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:03 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aa93958a-2835-45b0-9f2a-8afd6fd8ead3 1073741824 Sep 17 15:16:03 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a0b9dbb3-93f5-4436-8811-2f75e438daf3 tempest-VolumeDependencyTests-2111340249 None] Create snapshot completed successfully Sep 17 15:16:03 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.278s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] Deleted volume successfully. Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-53332d62-bce6-4274-9e80-74370a77984c tempest-ProjectReaderTests-1757589202 None] Lock "cinder-53b7372a-b88d-44b6-b53f-bd9ca63ff252-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:03 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aa93958a-2835-45b0-9f2a-8afd6fd8ead3 1073741824" returned: 0 in 0.547s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aa93958a-2835-45b0-9f2a-8afd6fd8ead3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:03 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aa93958a-2835-45b0-9f2a-8afd6fd8ead3 Sep 17 15:16:03 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Flow 'volume_create_manager' (edd89818-51ee-4b1e-87bf-4eacdcb97624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de68f10a-80d1-4467-87a1-f756d2909327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de68f10a-80d1-4467-87a1-f756d2909327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1164325551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a0fbdd-07c4-4ed4-8258-29de15c6aa26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c18099c77804f389961048c932e3afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:04Z,use_quota=True,user_id='f582d655c48d42af88baca1cead70409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e80a42-6c6c-4203-8871-6a5a1e2b3bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e80a42-6c6c-4203-8871-6a5a1e2b3bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa09662-6277-4564-875f-eb67f0c0e822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa09662-6277-4564-875f-eb67f0c0e822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87a0fbdd-07c4-4ed4-8258-29de15c6aa26', 'volume_name': 'volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e018a81-e8ee-496e-a2c2-528746977c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e018a81-e8ee-496e-a2c2-528746977c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0086bd1f-dcb8-4d79-8743-db4cec2c8132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:04 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Volume 87a0fbdd-07c4-4ed4-8258-29de15c6aa26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26', 'volume_size': 1} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:04 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aa93958a-2835-45b0-9f2a-8afd6fd8ead3" returned: 0 in 0.254s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.596s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb0ba531-39a1-4176-af34-046b788d4cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef9f070a9b64afb9c09df771b7feba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:56Z,use_quota=True,user_id='cbf53ab463304247a07299b0fad2dcd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Creating volume fb0ba531-39a1-4176-af34-046b788d4cff {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:04 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c9903c-56d5-42e3-a54a-42357789fce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa93958a-2835-45b0-9f2a-8afd6fd8ead3', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582fd771-310d-4327-9124-09c34e87069e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:04 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff 1073741824 Sep 17 15:16:04 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:04 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Volume volume-aa93958a-2835-45b0-9f2a-8afd6fd8ead3 (aa93958a-2835-45b0-9f2a-8afd6fd8ead3): created successfully Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582fd771-310d-4327-9124-09c34e87069e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Flow 'volume_create_manager' (088dd86f-289d-4874-b0f1-3fac5e28639d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:04 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8fc71b8a-ce05-44f4-bf80-bce3c901cd6f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Created volume successfully. Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "cinder-aa93958a-2835-45b0-9f2a-8afd6fd8ead3-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:04 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff 1073741824" returned: 0 in 0.518s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-aa93958a-2835-45b0-9f2a-8afd6fd8ead3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "cinder-quobyte-aa93958a-2835-45b0-9f2a-8afd6fd8ead3" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-quobyte-aa93958a-2835-45b0-9f2a-8afd6fd8ead3" acquired by "delete_volume" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:04 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff Sep 17 15:16:04 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd0818e-d43b-4aaf-a2c2-456cfc0caa0a]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aa93958a-2835-45b0-9f2a-8afd6fd8ead3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Flow 'volume_create_manager' (d02901a7-a9dd-41a2-a872-dc7165fa25e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcabe3c4-1877-4b62-98f9-fcda421eeadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcabe3c4-1877-4b62-98f9-fcda421eeadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1005256489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23c4ec3d-9108-48c6-bb5b-ae121977be26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5e9b1a432a4beaa25a8fbce51191db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f0993d74-9a54-4395-9430-73e4a0205bd1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:05Z,use_quota=True,user_id='cb762788d0c746ba96ac633cc4c680b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160e7af5-765e-4737-a3a2-61d6547f30c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160e7af5-765e-4737-a3a2-61d6547f30c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbef7bcf-0cec-4771-b7c1-03869b5b84a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbef7bcf-0cec-4771-b7c1-03869b5b84a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '23c4ec3d-9108-48c6-bb5b-ae121977be26', 'volume_name': 'volume-23c4ec3d-9108-48c6-bb5b-ae121977be26', 'volume_size': 1, 'snapshot_id': 'f0993d74-9a54-4395-9430-73e4a0205bd1'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a079174-d831-400c-a60a-c77f20ee2c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a079174-d831-400c-a60a-c77f20ee2c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305060ab-5ab4-4a5d-b696-0ec1997ef728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:04 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Volume 23c4ec3d-9108-48c6-bb5b-ae121977be26: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-23c4ec3d-9108-48c6-bb5b-ae121977be26', 'volume_size': 1, 'snapshot_id': 'f0993d74-9a54-4395-9430-73e4a0205bd1'} Sep 17 15:16:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:04 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aa93958a-2835-45b0-9f2a-8afd6fd8ead3 Sep 17 15:16:04 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:05 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff" returned: 0 in 0.268s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1164325551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a0fbdd-07c4-4ed4-8258-29de15c6aa26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c18099c77804f389961048c932e3afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:04Z,use_quota=True,user_id='f582d655c48d42af88baca1cead70409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Creating volume 87a0fbdd-07c4-4ed4-8258-29de15c6aa26 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:05 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:05 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26 1073741824 Sep 17 15:16:05 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Attempting download of ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8 ((None, [{'url': 'file:///opt/stack/data/glance/images/ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8', 'metadata': {}}])) to volume fb0ba531-39a1-4176-af34-046b788d4cff. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea48e80-d1f9-4277-b923-3aeec67dc116]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_6xf1w86t {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:05 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aa93958a-2835-45b0-9f2a-8afd6fd8ead3" returned: 0 in 0.403s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aa93958a-2835-45b0-9f2a-8afd6fd8ead3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:05 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aa93958a-2835-45b0-9f2a-8afd6fd8ead3 Sep 17 15:16:05 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:05 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_6xf1w86t Sep 17 15:16:05 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:05 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_6xf1w86t" returned: 0 in 0.338s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_6xf1w86t {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:05 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26 1073741824" returned: 0 in 0.452s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:05 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aa93958a-2835-45b0-9f2a-8afd6fd8ead3" returned: 0 in 0.299s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-quobyte-aa93958a-2835-45b0-9f2a-8afd6fd8ead3" released by "delete_volume" :: held 0.766s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:05 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26 Sep 17 15:16:05 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:05 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_6xf1w86t Sep 17 15:16:05 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Created reservations ['73d733af-529d-4a90-b8c5-195df6691db9', '534e791b-dd84-4bf9-a599-f63132b668b6', 'daa9cb3c-7e2e-4646-bdd6-bb39629162f4', '0c3c492b-89d4-4a10-826d-e51e9246544f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:05 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:05 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:05 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26" returned: 0 in 0.299s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:05 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.923s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Acquiring lock "cinder-quobyte-f0993d74-9a54-4395-9430-73e4a0205bd1-23c4ec3d-9108-48c6-bb5b-ae121977be26" by "_create_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "cinder-5163db1e-dca8-4da1-8825-29b73dde9c74-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_6xf1w86t" returned: 1 in 0.405s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_6xf1w86t' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[eece9109-12e2-421c-b185-f7f2ab42958f]: (4, 'raw') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0086bd1f-dcb8-4d79-8743-db4cec2c8132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c3abc6-7e46-4588-b63b-b7f017cf830b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-5163db1e-dca8-4da1-8825-29b73dde9c74-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Lock "cinder-quobyte-f0993d74-9a54-4395-9430-73e4a0205bd1-23c4ec3d-9108-48c6-bb5b-ae121977be26" acquired by "_create_volume_from_snapshot" :: waited 0.077s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Creating volume 23c4ec3d-9108-48c6-bb5b-ae121977be26 from snapshot f0993d74-9a54-4395-9430-73e4a0205bd1 {{(pid=86082) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Acquiring lock "cinder-quobyte-23c4ec3d-9108-48c6-bb5b-ae121977be26" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:05 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Volume volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26 (87a0fbdd-07c4-4ed4-8258-29de15c6aa26): created successfully Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c3abc6-7e46-4588-b63b-b7f017cf830b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Flow 'volume_create_manager' (edd89818-51ee-4b1e-87bf-4eacdcb97624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Lock "cinder-quobyte-23c4ec3d-9108-48c6-bb5b-ae121977be26" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] snapshot: f0993d74-9a54-4395-9430-73e4a0205bd1, volume: 23c4ec3d-9108-48c6-bb5b-ae121977be26, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:16:06 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ac3784c5-725a-4e70-bcde-2195969631b5 tempest-ProjectReaderTests-1757589202 None] Created volume successfully. Sep 17 15:16:06 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:06 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD Sep 17 15:16:06 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.343s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "cinder-quobyte-5163db1e-dca8-4da1-8825-29b73dde9c74" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:06 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Deleted volume successfully. Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a36329-11c7-48a4-a7f3-44a9e61d8d66]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-quobyte-5163db1e-dca8-4da1-8825-29b73dde9c74" acquired by "delete_volume" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8fc93ebf-54f1-4c38-abaf-d97d4ed987a2 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-aa93958a-2835-45b0-9f2a-8afd6fd8ead3-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1465982-3679-417c-afda-de3098fc2d07]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5163db1e-dca8-4da1-8825-29b73dde9c74 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:06 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1 Sep 17 15:16:06 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:06 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5163db1e-dca8-4da1-8825-29b73dde9c74 Sep 17 15:16:06 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:06 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:06 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD Sep 17 15:16:06 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:06 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1" returned: 0 in 0.421s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cea28cfe-2843-4d8f-8580-e4eb57335567(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:16:06 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5163db1e-dca8-4da1-8825-29b73dde9c74" returned: 0 in 0.385s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5163db1e-dca8-4da1-8825-29b73dde9c74 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c639f747-5cb9-4245-b033-32e160a026e1]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:06 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5163db1e-dca8-4da1-8825-29b73dde9c74 Sep 17 15:16:06 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:06 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 Sep 17 15:16:06 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:06 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8 was raw, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:06 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff Sep 17 15:16:06 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:06 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5163db1e-dca8-4da1-8825-29b73dde9c74" returned: 0 in 0.300s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-quobyte-5163db1e-dca8-4da1-8825-29b73dde9c74" released by "delete_volume" :: held 0.740s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] Created reservations ['15e45ac8-24f4-4dc3-bcd9-537837abafcf', '18b0998e-23d9-4b8f-aa5a-ac1064433229', '69ebb43e-8553-4494-9bbf-9cd88d1d3468', '7c27460d-ae90-4b2e-8d89-d211aa420878'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:06 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567" returned: 0 in 0.412s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Path /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-23c4ec3d-9108-48c6-bb5b-ae121977be26 not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-23c4ec3d-9108-48c6-bb5b-ae121977be26 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:07 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-23c4ec3d-9108-48c6-bb5b-ae121977be26 Sep 17 15:16:07 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:07 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:07 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "cinder-d5f2e90f-4835-4e17-9ddd-f92cf92da54d-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-d5f2e90f-4835-4e17-9ddd-f92cf92da54d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "cinder-quobyte-d5f2e90f-4835-4e17-9ddd-f92cf92da54d" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-quobyte-d5f2e90f-4835-4e17-9ddd-f92cf92da54d" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9e764b-5a8f-41f1-aa47-69241307bdf2]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d5f2e90f-4835-4e17-9ddd-f92cf92da54d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:07 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.369s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] Deleted volume successfully. Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:07 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff" returned: 0 in 0.707s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8_5bs538dadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:16:07 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:07 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d5f2e90f-4835-4e17-9ddd-f92cf92da54d Sep 17 15:16:07 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-953fe82a-56a3-42d0-a70a-07f17659085d tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-5163db1e-dca8-4da1-8825-29b73dde9c74-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:07 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff 1G Sep 17 15:16:07 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:07 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d5f2e90f-4835-4e17-9ddd-f92cf92da54d" returned: 0 in 0.541s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d5f2e90f-4835-4e17-9ddd-f92cf92da54d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:07 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d5f2e90f-4835-4e17-9ddd-f92cf92da54d Sep 17 15:16:07 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:07 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff 1G" returned: 0 in 0.503s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Downloaded image ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8 ((None, [{'url': 'file:///opt/stack/data/glance/images/ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8', 'metadata': {}}])) to volume fb0ba531-39a1-4176-af34-046b788d4cff successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Temporary image ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8 for user cbf53ab463304247a07299b0fad2dcd8 is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Marking volume fb0ba531-39a1-4176-af34-046b788d4cff as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Copying metadata from image ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8 to fb0ba531-39a1-4176-af34-046b788d4cff. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:16:07 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Creating volume glance metadata for volume fb0ba531-39a1-4176-af34-046b788d4cff backed by image ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8 with: {'image_id': 'ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd2a9396886f0818f67ad87b89d8b759c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:16:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a82e34f-8593-45ac-ae2f-d197955251c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb0ba531-39a1-4176-af34-046b788d4cff', 'volume_size': 1, 'image_id': 'ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd2a9396886f0818f67ad87b89d8b759c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1ef9f070a9b64afb9c09df771b7feba4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e110f9640a690f8b7e3ec74fa661a76a22cfb94e3394e4140ddf26a290fac498214e67e68d363165974023a1c24149889439f0af11181e5402044340f7e01521', 'id': 'ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8', 'created_at': datetime.datetime(2026, 9, 17, 13, 15, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 15, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ed71db7d-6074-40c1-96b2-b0fe9f6ecfe8/file', 'properties': {}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ed5041-0a30-4466-af90-41b89bb00f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:08 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Volume volume-fb0ba531-39a1-4176-af34-046b788d4cff (fb0ba531-39a1-4176-af34-046b788d4cff): created successfully Sep 17 15:16:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ed5041-0a30-4466-af90-41b89bb00f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Flow 'volume_create_manager' (ad4c0813-c744-49ee-9790-8e3c61354808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:08 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ec09dcd6-1a49-42cd-ae5d-f1467d1249c2 tempest-VolumeImageDependencyTests-1335905349 None] Created volume successfully. Sep 17 15:16:08 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-d5f2e90f-4835-4e17-9ddd-f92cf92da54d" returned: 0 in 0.489s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-quobyte-d5f2e90f-4835-4e17-9ddd-f92cf92da54d" released by "delete_volume" :: held 1.100s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:08 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Created reservations ['0bb146bb-1d21-46b1-8f8b-dece21cd929e', '607974b3-bcc8-43e7-936f-e7a73e4b0f8d', '16e80548-1a83-4854-8368-89d9df281fa1', '097c2461-151e-40a5-8521-284b7159905f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:08 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:08 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:08 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.292s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:08 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:08 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Deleted volume successfully. Sep 17 15:16:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e3a2b833-806e-48ad-8ab3-fcf8e9b212e1 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-d5f2e90f-4835-4e17-9ddd-f92cf92da54d-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] Acquiring lock "cinder-fb0ba531-39a1-4176-af34-046b788d4cff-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] Lock "cinder-fb0ba531-39a1-4176-af34-046b788d4cff-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] Acquiring lock "cinder-quobyte-fb0ba531-39a1-4176-af34-046b788d4cff" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] Lock "cinder-quobyte-fb0ba531-39a1-4176-af34-046b788d4cff" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:09 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[482dabb7-a25f-4126-b09e-5b3f6eeda420]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:09 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff Sep 17 15:16:09 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "cinder-3baff944-e236-4148-807a-7a4c1a940737-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-3baff944-e236-4148-807a-7a4c1a940737-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "cinder-quobyte-3baff944-e236-4148-807a-7a4c1a940737" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-quobyte-3baff944-e236-4148-807a-7a4c1a940737" acquired by "delete_volume" :: waited 0.047s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:09 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27d484d-f58a-412e-9e9f-3df191fc6c50]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3baff944-e236-4148-807a-7a4c1a940737 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:09 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3baff944-e236-4148-807a-7a4c1a940737 Sep 17 15:16:09 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:09 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff" returned: 0 in 0.745s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:09 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff Sep 17 15:16:09 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:10 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3baff944-e236-4148-807a-7a4c1a940737" returned: 0 in 0.601s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3baff944-e236-4148-807a-7a4c1a940737 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:10 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3baff944-e236-4148-807a-7a4c1a940737 Sep 17 15:16:10 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:10 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fb0ba531-39a1-4176-af34-046b788d4cff" returned: 0 in 0.422s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] Lock "cinder-quobyte-fb0ba531-39a1-4176-af34-046b788d4cff" released by "delete_volume" :: held 1.259s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] Created reservations ['a92bbe94-49d6-4e88-b5ff-9b576cc30db2', '02b347fd-b626-48c6-a619-241192233ada', 'ed0add1b-a403-4bd9-81ed-95c51bee7bab', '0db95a94-0393-4e3d-889c-f10dbe0092a1'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:10 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-3baff944-e236-4148-807a-7a4c1a940737" returned: 0 in 0.378s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:10 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:10 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-quobyte-3baff944-e236-4148-807a-7a4c1a940737" released by "delete_volume" :: held 1.093s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Created reservations ['0feaecfe-3289-423a-9068-074696ee0b88', '6ada3b84-c9a3-4070-b18a-f10e64a6804e', '51f051ba-95dd-4770-94ce-9855c185bffe', 'bfbbb7e3-c076-4b87-aa36-c1671d8f4d05'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:11 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:11 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:11 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.377s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:11 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] Deleted volume successfully. Sep 17 15:16:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c5be1322-9c26-4be2-9d27-f0c2708ef1c5 tempest-VolumeImageDependencyTests-1335905349 None] Lock "cinder-fb0ba531-39a1-4176-af34-046b788d4cff-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:11 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.400s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:11 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Deleted volume successfully. Sep 17 15:16:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-96bb3358-85d7-4a88-8558-e63f09b55ee9 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-3baff944-e236-4148-807a-7a4c1a940737-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "cinder-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "cinder-quobyte-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-quobyte-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58ce195-4194-4ebb-8f02-7f0e0b8eedee]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:12 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec Sep 17 15:16:12 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:12 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec" returned: 0 in 0.687s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:12 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec Sep 17 15:16:12 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:13 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec" returned: 0 in 0.452s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-quobyte-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec" released by "delete_volume" :: held 1.257s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:13 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Created reservations ['43b031a0-e258-4ea0-b0bb-631ced666e73', '055112f4-8928-4c67-afca-d7525f84b378', '9487e70e-c11b-432e-80d0-60b03618c406', 'd755e126-dc62-4d77-bca6-a548e62fecce'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:13 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:13 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:14 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.456s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:14 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Deleted volume successfully. Sep 17 15:16:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8c9bac29-fb1c-48e8-a378-942e1dfb2039 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-fa8b8543-c6c6-43e4-9bad-ea0ce06b58ec-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "cinder-b5b6da34-9a0a-493a-8038-337525ec39e9-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-b5b6da34-9a0a-493a-8038-337525ec39e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "cinder-quobyte-15ee8a17-90e1-434d-a15b-5df5ecdb68ea" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-quobyte-15ee8a17-90e1-434d-a15b-5df5ecdb68ea" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "cinder-quobyte-b5b6da34-9a0a-493a-8038-337525ec39e9" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-quobyte-b5b6da34-9a0a-493a-8038-337525ec39e9" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Deleting offline snapshot b5b6da34-9a0a-493a-8038-337525ec39e9 of volume 15ee8a17-90e1-434d-a15b-5df5ecdb68ea {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:16:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] snapshot_file for this snap is: volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:16:14 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25beeab-c8c0-443d-acb4-f3b1376ef138]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:14 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9 Sep 17 15:16:14 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:15 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9" returned: 0 in 0.623s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fd0066-7d4c-4dce-93a6-ec0db105b70f]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:15 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-23c4ec3d-9108-48c6-bb5b-ae121977be26" returned: 0 in 8.421s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Image conversion details: src /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567, size 1024.00 MB, duration 8.42 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-23c4ec3d-9108-48c6-bb5b-ae121977be26 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:16:15 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Converted 1024.00 MB image at 121.56 MB/s Sep 17 15:16:15 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-23c4ec3d-9108-48c6-bb5b-ae121977be26 is being set with open permissions: ugo+rw Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-23c4ec3d-9108-48c6-bb5b-ae121977be26 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:15 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-23c4ec3d-9108-48c6-bb5b-ae121977be26 Sep 17 15:16:15 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:15 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea Sep 17 15:16:15 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:15 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-23c4ec3d-9108-48c6-bb5b-ae121977be26" returned: 0 in 0.380s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Lock "cinder-quobyte-23c4ec3d-9108-48c6-bb5b-ae121977be26" released by "_copy_volume_from_snapshot" :: held 9.785s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:15 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea" returned: 0 in 0.467s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:15 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9 Sep 17 15:16:15 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Lock "cinder-quobyte-f0993d74-9a54-4395-9430-73e4a0205bd1-23c4ec3d-9108-48c6-bb5b-ae121977be26" released by "_create_volume_from_snapshot" :: held 9.913s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.992s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.456s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] Creating offline snapshot f97cb7d5-0278-4005-813a-03f423a852b3 of volume 87a0fbdd-07c4-4ed4-8258-29de15c6aa26 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305060ab-5ab4-4a5d-b696-0ec1997ef728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23c4ec3d-9108-48c6-bb5b-ae121977be26', 'volume_size': 1, 'snapshot_id': 'f0993d74-9a54-4395-9430-73e4a0205bd1'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d42e6b4-f944-446c-b5b5-b67da82c86ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[43400032-6276-4b19-8999-7aebe7055b87]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:15 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Volume volume-23c4ec3d-9108-48c6-bb5b-ae121977be26 (23c4ec3d-9108-48c6-bb5b-ae121977be26): created successfully Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d42e6b4-f944-446c-b5b5-b67da82c86ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Flow 'volume_create_manager' (d02901a7-a9dd-41a2-a872-dc7165fa25e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ddff6718-7369-42a9-8233-f6c7bb956554 tempest-VolumeDependencyTests-2111340249 None] Created volume successfully. Sep 17 15:16:16 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26 Sep 17 15:16:16 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] Acquiring lock "cinder-f0993d74-9a54-4395-9430-73e4a0205bd1-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:16 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9" returned: 0 in 0.413s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:16 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9 Sep 17 15:16:16 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] Lock "cinder-f0993d74-9a54-4395-9430-73e4a0205bd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] Acquiring lock "cinder-quobyte-cea28cfe-2843-4d8f-8580-e4eb57335567" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] Lock "cinder-quobyte-cea28cfe-2843-4d8f-8580-e4eb57335567" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] Acquiring lock "cinder-quobyte-f0993d74-9a54-4395-9430-73e4a0205bd1" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] Lock "cinder-quobyte-f0993d74-9a54-4395-9430-73e4a0205bd1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] Deleting offline snapshot f0993d74-9a54-4395-9430-73e4a0205bd1 of volume cea28cfe-2843-4d8f-8580-e4eb57335567 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] snapshot_file for this snap is: volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:16:16 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a76949c-2b3c-4a8a-ac62-446f51eea53a]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26" returned: 0 in 0.462s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:16 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3 1G Sep 17 15:16:16 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:16 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1 Sep 17 15:16:16 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:16 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea.b5b6da34-9a0a-493a-8038-337525ec39e9" returned: 0 in 0.329s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-quobyte-b5b6da34-9a0a-493a-8038-337525ec39e9" released by "_delete_snapshot" :: held 2.070s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-quobyte-15ee8a17-90e1-434d-a15b-5df5ecdb68ea" released by "delete_snapshot" :: held 2.128s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Created reservations ['b0124956-31ee-466f-ab44-dc2e79a5f945', 'ea3831dc-f8a8-421c-b2a8-f670d20e27c7', '2edbebd6-cd48-44ad-bfb3-4fc5dce3876d', '8223f487-16bd-4f2e-a0a9-7696f3127aa2'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:16 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Delete snapshot completed successfully. Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b6ce157d-7a9a-408f-90e2-389e9b67b06f tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-b5b6da34-9a0a-493a-8038-337525ec39e9-delete_snapshot" released by "delete_snapshot" :: held 2.355s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Flow 'volume_create_manager' (d7705dd7-4e8a-42df-bc23-29d8888b40cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7bd9fa-aade-4fba-a8d3-c0f3b29fc8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:16 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:16 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7bd9fa-aade-4fba-a8d3-c0f3b29fc8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db2df53-9e91-4262-8b54-e21f4ce2a121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd9e198df7945e192cd0df5756e3688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:17Z,use_quota=True,user_id='ce4182fca4db41fa84d13ea028e3b6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5e5752-4fa9-4d65-b124-28e35ed5cdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5e5752-4fa9-4d65-b124-28e35ed5cdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b80c299-e356-4f83-98a4-38bb7b8f7b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b80c299-e356-4f83-98a4-38bb7b8f7b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7db2df53-9e91-4262-8b54-e21f4ce2a121', 'volume_name': 'volume-7db2df53-9e91-4262-8b54-e21f4ce2a121', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da9897b-5ee1-45cf-ad1c-eb38d6aabdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9da9897b-5ee1-45cf-ad1c-eb38d6aabdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddec33d9-fe24-490b-ac25-7904ca1db49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:16 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Volume 7db2df53-9e91-4262-8b54-e21f4ce2a121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7db2df53-9e91-4262-8b54-e21f4ce2a121', 'volume_size': 1} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1" returned: 0 in 0.635s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3 1G" returned: 0 in 0.623s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cea28cfe-2843-4d8f-8580-e4eb57335567(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3019163a-23db-48fa-ab84-1265f7523b50]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:17 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3 Sep 17 15:16:17 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:17 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 Sep 17 15:16:17 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:17 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3" returned: 0 in 0.314s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:17 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3 is being set with open permissions: ugo+rw Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:17 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3 Sep 17 15:16:17 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:17 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567" returned: 0 in 0.540s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:17 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3" returned: 0 in 0.256s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:17 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1 Sep 17 15:16:17 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:17 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.info Sep 17 15:16:17 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "cinder-15ee8a17-90e1-434d-a15b-5df5ecdb68ea-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-15ee8a17-90e1-434d-a15b-5df5ecdb68ea-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "cinder-quobyte-15ee8a17-90e1-434d-a15b-5df5ecdb68ea" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-quobyte-15ee8a17-90e1-434d-a15b-5df5ecdb68ea" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f919a2-e521-44f9-9a80-f683a0dd1330]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:17 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.info" returned: 0 in 0.328s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:17 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.info is being set with open permissions: ugo+rw Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:17 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.info Sep 17 15:16:17 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:17 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1" returned: 0 in 0.410s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:17 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea Sep 17 15:16:17 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:18 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1 Sep 17 15:16:18 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:18 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.info" returned: 0 in 0.269s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.371s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.239s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7db2df53-9e91-4262-8b54-e21f4ce2a121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd9e198df7945e192cd0df5756e3688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:17Z,use_quota=True,user_id='ce4182fca4db41fa84d13ea028e3b6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Creating volume 7db2df53-9e91-4262-8b54-e21f4ce2a121 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:18 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7db2df53-9e91-4262-8b54-e21f4ce2a121 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:18 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567.f0993d74-9a54-4395-9430-73e4a0205bd1" returned: 0 in 0.277s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:18 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:18 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7db2df53-9e91-4262-8b54-e21f4ce2a121 1073741824 Sep 17 15:16:18 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea" returned: 0 in 0.416s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:18 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea Sep 17 15:16:18 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f32ab4bc-f7c9-4c64-a6b8-96630821956f tempest-ProjectReaderTests-1757589202 None] Create snapshot completed successfully Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] Lock "cinder-quobyte-f0993d74-9a54-4395-9430-73e4a0205bd1" released by "_delete_snapshot" :: held 2.032s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] Lock "cinder-quobyte-cea28cfe-2843-4d8f-8580-e4eb57335567" released by "delete_snapshot" :: held 2.064s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] Created reservations ['43b01f90-c8c7-4690-84ff-a3ddd9a099d2', '4d8447ae-ab2e-4d74-8d0a-9113fb1059be', '02408d2e-294a-4e9f-865c-7f3429296dd4', '243e83e0-45e2-4c16-8b4b-d3b685b3eb45'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] Delete snapshot completed successfully. Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-390302eb-4428-4927-9ab9-718924bfdd07 tempest-VolumeDependencyTests-2111340249 None] Lock "cinder-f0993d74-9a54-4395-9430-73e4a0205bd1-delete_snapshot" released by "delete_snapshot" :: held 2.216s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:18 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-15ee8a17-90e1-434d-a15b-5df5ecdb68ea" returned: 0 in 0.286s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-quobyte-15ee8a17-90e1-434d-a15b-5df5ecdb68ea" released by "delete_volume" :: held 0.777s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Created reservations ['39ff90f7-c05d-4512-b680-397bd633409f', 'f5c18b02-16cd-4455-9cf7-8e324b2a02d7', '5f9bfea5-f54c-40ce-9fde-e30fb09fbfd3', '302abe0e-e6b7-405a-b6f2-4f4c2f494356'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:18 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7db2df53-9e91-4262-8b54-e21f4ce2a121 1073741824" returned: 0 in 0.463s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:18 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:18 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7db2df53-9e91-4262-8b54-e21f4ce2a121 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:18 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7db2df53-9e91-4262-8b54-e21f4ce2a121 Sep 17 15:16:18 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:18 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.270s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Deleted volume successfully. Sep 17 15:16:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-884cbc42-8784-4851-96fb-663858738560 tempest-CreateVolumesFromSnapshotTest-2029498003 None] Lock "cinder-15ee8a17-90e1-434d-a15b-5df5ecdb68ea-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:19 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7db2df53-9e91-4262-8b54-e21f4ce2a121" returned: 0 in 0.276s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddec33d9-fe24-490b-ac25-7904ca1db49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7db2df53-9e91-4262-8b54-e21f4ce2a121', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18720a57-2c4d-43d6-9450-4b23cb2a4d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-f97cb7d5-0278-4005-813a-03f423a852b3-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:19 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Volume volume-7db2df53-9e91-4262-8b54-e21f4ce2a121 (7db2df53-9e91-4262-8b54-e21f4ce2a121): created successfully Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18720a57-2c4d-43d6-9450-4b23cb2a4d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Flow 'volume_create_manager' (d7705dd7-4e8a-42df-bc23-29d8888b40cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-f97cb7d5-0278-4005-813a-03f423a852b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-quobyte-87a0fbdd-07c4-4ed4-8258-29de15c6aa26" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:19 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f8418b56-5502-4e48-af13-64edec65b50f tempest-CinderUnicodeTest-834048033 None] Created volume successfully. Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-87a0fbdd-07c4-4ed4-8258-29de15c6aa26" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-quobyte-f97cb7d5-0278-4005-813a-03f423a852b3" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-f97cb7d5-0278-4005-813a-03f423a852b3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] Deleting offline snapshot f97cb7d5-0278-4005-813a-03f423a852b3 of volume 87a0fbdd-07c4-4ed4-8258-29de15c6aa26 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] snapshot_file for this snap is: volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f6cc80-76b2-4f66-a355-af405622a0fe]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:19 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3 Sep 17 15:16:19 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] Acquiring lock "cinder-cea28cfe-2843-4d8f-8580-e4eb57335567-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] Lock "cinder-cea28cfe-2843-4d8f-8580-e4eb57335567-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] Acquiring lock "cinder-quobyte-cea28cfe-2843-4d8f-8580-e4eb57335567" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] Lock "cinder-quobyte-cea28cfe-2843-4d8f-8580-e4eb57335567" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48d7eaf-1edc-48f4-91be-35dd48671a79]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:19 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3" returned: 0 in 0.435s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3316ea09-a49c-49ff-8477-6d901e34ffe6]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:19 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 Sep 17 15:16:19 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:19 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26 Sep 17 15:16:19 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:20 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567" returned: 0 in 0.450s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:20 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26" returned: 0 in 0.413s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:20 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567 Sep 17 15:16:20 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:20 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3 Sep 17 15:16:20 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:20 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-cea28cfe-2843-4d8f-8580-e4eb57335567" returned: 0 in 0.428s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] Lock "cinder-quobyte-cea28cfe-2843-4d8f-8580-e4eb57335567" released by "delete_volume" :: held 0.980s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:20 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3" returned: 0 in 0.503s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:20 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3 Sep 17 15:16:20 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] Created reservations ['b50f1716-b699-4a0d-90cc-748a1fb140ad', '3185ff7b-42f0-4cd7-87a8-ba1b623145ed', '5867886b-9768-4ee5-a29f-f8efa2d2cd69', '87f1885a-1083-408d-aef4-bbbcdeaefd89'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Flow 'volume_create_manager' (a86372dd-642f-4537-a9da-f77841c97ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e57ac2-ffc5-4e65-914f-da63b95f882d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e57ac2-ffc5-4e65-914f-da63b95f882d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-431867338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98e67a8-d43f-4b21-bec5-fac536d771fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd9e198df7945e192cd0df5756e3688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:21Z,use_quota=True,user_id='ce4182fca4db41fa84d13ea028e3b6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f33411-fe5b-4fe5-99fe-b60d428fb3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f33411-fe5b-4fe5-99fe-b60d428fb3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee3cd79-0247-4035-a748-9cb2a19e87a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee3cd79-0247-4035-a748-9cb2a19e87a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a98e67a8-d43f-4b21-bec5-fac536d771fd', 'volume_name': 'volume-a98e67a8-d43f-4b21-bec5-fac536d771fd', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbd5975-9fd3-422d-809a-7566d0b1d704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cbd5975-9fd3-422d-809a-7566d0b1d704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35fbe8e1-e7ae-4404-b4e0-2ee428cb948f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:20 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Volume a98e67a8-d43f-4b21-bec5-fac536d771fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a98e67a8-d43f-4b21-bec5-fac536d771fd', 'volume_size': 1} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-431867338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a98e67a8-d43f-4b21-bec5-fac536d771fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fd9e198df7945e192cd0df5756e3688',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:21Z,use_quota=True,user_id='ce4182fca4db41fa84d13ea028e3b6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Creating volume a98e67a8-d43f-4b21-bec5-fac536d771fd {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:20 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:20 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd 1073741824 Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:20 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:20 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:20 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:20 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26.f97cb7d5-0278-4005-813a-03f423a852b3" returned: 0 in 0.297s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-f97cb7d5-0278-4005-813a-03f423a852b3" released by "_delete_snapshot" :: held 1.764s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-87a0fbdd-07c4-4ed4-8258-29de15c6aa26" released by "delete_snapshot" :: held 1.792s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:20 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] Created reservations ['2f522656-3cad-4f5e-99c4-fcc3e7533a30', 'f304d647-7ef0-4eb3-8c85-6645439a7734', '8b5a255d-cea0-49fb-a9e5-7cf04e94e1a2', '7851317c-128d-4b77-91ab-928fe5cd92b7'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] Delete snapshot completed successfully. Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-263bdd29-616c-4ac0-894d-ad94846c1389 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-f97cb7d5-0278-4005-813a-03f423a852b3-delete_snapshot" released by "delete_snapshot" :: held 1.944s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:21 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.311s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] Deleted volume successfully. Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ce7ee279-8ef1-43ee-8039-992038fc877a tempest-VolumeDependencyTests-2111340249 None] Lock "cinder-cea28cfe-2843-4d8f-8580-e4eb57335567-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-87a0fbdd-07c4-4ed4-8258-29de15c6aa26-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-87a0fbdd-07c4-4ed4-8258-29de15c6aa26-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:21 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd 1073741824" returned: 0 in 0.552s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-quobyte-87a0fbdd-07c4-4ed4-8258-29de15c6aa26" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-87a0fbdd-07c4-4ed4-8258-29de15c6aa26" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c84bfb-5f26-44cd-a8a7-a418571ac32a]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:21 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd Sep 17 15:16:21 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:21 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26 Sep 17 15:16:21 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] Acquiring lock "cinder-23c4ec3d-9108-48c6-bb5b-ae121977be26-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] Lock "cinder-23c4ec3d-9108-48c6-bb5b-ae121977be26-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:21 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd" returned: 0 in 0.349s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35fbe8e1-e7ae-4404-b4e0-2ee428cb948f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a98e67a8-d43f-4b21-bec5-fac536d771fd', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fccec1f2-a399-4ec4-a055-a3251db3b7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] Acquiring lock "cinder-quobyte-23c4ec3d-9108-48c6-bb5b-ae121977be26" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:21 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Volume volume-a98e67a8-d43f-4b21-bec5-fac536d771fd (a98e67a8-d43f-4b21-bec5-fac536d771fd): created successfully Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fccec1f2-a399-4ec4-a055-a3251db3b7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Flow 'volume_create_manager' (a86372dd-642f-4537-a9da-f77841c97ee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-28eb7a19-e805-4de5-9373-630af832f835 tempest-CinderUnicodeTest-834048033 None] Created volume successfully. Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] Lock "cinder-quobyte-23c4ec3d-9108-48c6-bb5b-ae121977be26" acquired by "delete_volume" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2be7a00-70e0-48b8-b076-1050f5780694]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-23c4ec3d-9108-48c6-bb5b-ae121977be26 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:21 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26" returned: 0 in 0.500s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:21 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26 Sep 17 15:16:21 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:21 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-23c4ec3d-9108-48c6-bb5b-ae121977be26 Sep 17 15:16:21 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:22 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-87a0fbdd-07c4-4ed4-8258-29de15c6aa26" returned: 0 in 0.278s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-87a0fbdd-07c4-4ed4-8258-29de15c6aa26" released by "delete_volume" :: held 0.853s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] Created reservations ['dd2b274c-d73d-4b7a-88f3-e6843c694c1a', 'dc6282bd-870b-4120-bd82-a1b927705245', '2458a4fc-7aca-4266-88c0-a855b2d6ad24', '9e3ebd80-92bd-40d5-acf3-cf1d483572a8'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:22 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-23c4ec3d-9108-48c6-bb5b-ae121977be26" returned: 0 in 0.396s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-23c4ec3d-9108-48c6-bb5b-ae121977be26 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:22 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-23c4ec3d-9108-48c6-bb5b-ae121977be26 Sep 17 15:16:22 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:22 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:22 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:22 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-23c4ec3d-9108-48c6-bb5b-ae121977be26" returned: 0 in 0.337s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] Lock "cinder-quobyte-23c4ec3d-9108-48c6-bb5b-ae121977be26" released by "delete_volume" :: held 0.803s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:22 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.313s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] Deleted volume successfully. Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18ef9e2f-4fae-41c5-a8e1-ddc1cfba68b4 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-87a0fbdd-07c4-4ed4-8258-29de15c6aa26-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] Created reservations ['8e3326b1-de17-4b1b-8e09-42d857c32638', 'a41f8e84-46a9-4c87-8927-c85bb0e1c9e2', '7e0a3c4e-ac1f-4e28-bc46-f443aac67a92', '8bd85624-3c4b-4fcb-a64b-1bb38cb19132'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:22 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:22 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Flow 'volume_create_manager' (26731a1b-f978-4c6e-a0b3-7284818e0779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabb77a5-5086-4dd0-b052-e717841e9aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabb77a5-5086-4dd0-b052-e717841e9aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-326221005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b3392e-f273-48d1-9d9f-6d474aa6d8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c18099c77804f389961048c932e3afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:23Z,use_quota=True,user_id='f582d655c48d42af88baca1cead70409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cded87-9763-4ca1-9a8f-f9bbed7b6268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cded87-9763-4ca1-9a8f-f9bbed7b6268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b3ade6-d176-4b05-b9c4-78cdbcfd44cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b3ade6-d176-4b05-b9c4-78cdbcfd44cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40b3392e-f273-48d1-9d9f-6d474aa6d8a1', 'volume_name': 'volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2d6b0e-de99-4ddb-aae0-1428abbb615a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2d6b0e-de99-4ddb-aae0-1428abbb615a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403e0990-8034-4f5b-ae93-8c296afbbd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:23 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Volume 40b3392e-f273-48d1-9d9f-6d474aa6d8a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1', 'volume_size': 1} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-326221005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b3392e-f273-48d1-9d9f-6d474aa6d8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c18099c77804f389961048c932e3afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:23Z,use_quota=True,user_id='f582d655c48d42af88baca1cead70409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Creating volume 40b3392e-f273-48d1-9d9f-6d474aa6d8a1 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:23 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:23 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1 1073741824 Sep 17 15:16:23 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:23 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.368s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] Deleted volume successfully. Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b703e801-f4bf-4160-9cea-d9752980e8a8 tempest-VolumeDependencyTests-2111340249 None] Lock "cinder-23c4ec3d-9108-48c6-bb5b-ae121977be26-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:23 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1 1073741824" returned: 0 in 0.541s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:23 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1 Sep 17 15:16:23 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:24 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1" returned: 0 in 0.297s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.817s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403e0990-8034-4f5b-ae93-8c296afbbd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b716afa-eae5-4eb0-aced-5fbb0b916c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] Creating offline snapshot 9f33c3a3-c81c-4879-882e-fdb28ad61f62 of volume a98e67a8-d43f-4b21-bec5-fac536d771fd {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:16:24 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Volume volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1 (40b3392e-f273-48d1-9d9f-6d474aa6d8a1): created successfully Sep 17 15:16:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b716afa-eae5-4eb0-aced-5fbb0b916c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Flow 'volume_create_manager' (26731a1b-f978-4c6e-a0b3-7284818e0779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:24 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[54006018-6c84-4b25-960c-5b25a06c3f09]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:24 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-226c7352-f3d0-49e8-aa21-f58a63920e82 tempest-ProjectReaderTests-1757589202 None] Created volume successfully. Sep 17 15:16:24 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd Sep 17 15:16:24 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:24 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd" returned: 0 in 0.475s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:24 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62 1G Sep 17 15:16:24 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:25 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62 1G" returned: 0 in 0.539s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a98e67a8-d43f-4b21-bec5-fac536d771fd -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:25 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a98e67a8-d43f-4b21-bec5-fac536d771fd -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62 Sep 17 15:16:25 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:25 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a98e67a8-d43f-4b21-bec5-fac536d771fd -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62" returned: 0 in 0.377s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:25 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62 is being set with open permissions: ugo+rw Sep 17 15:16:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:25 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62 Sep 17 15:16:25 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:25 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62" returned: 0 in 0.278s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:25 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.info Sep 17 15:16:25 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:26 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.info" returned: 0 in 0.295s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:26 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.info is being set with open permissions: ugo+rw Sep 17 15:16:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:26 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.info Sep 17 15:16:26 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:26 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.info" returned: 0 in 0.282s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.152s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] Creating offline snapshot e795aaed-a513-4ea4-ab9d-5876de11f4a6 of volume 40b3392e-f273-48d1-9d9f-6d474aa6d8a1 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:16:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f9708197-0b6c-4ec4-8b7b-8d03a81e278a tempest-CinderUnicodeTest-834048033 None] Create snapshot completed successfully Sep 17 15:16:26 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e536829-0ca8-4be1-976e-a278a4447cc3]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:26 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1 Sep 17 15:16:26 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:26 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1" returned: 0 in 0.413s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:27 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6 1G Sep 17 15:16:27 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] Acquiring lock "cinder-9f33c3a3-c81c-4879-882e-fdb28ad61f62-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] Lock "cinder-9f33c3a3-c81c-4879-882e-fdb28ad61f62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] Acquiring lock "cinder-quobyte-a98e67a8-d43f-4b21-bec5-fac536d771fd" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] Lock "cinder-quobyte-a98e67a8-d43f-4b21-bec5-fac536d771fd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] Acquiring lock "cinder-quobyte-9f33c3a3-c81c-4879-882e-fdb28ad61f62" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] Lock "cinder-quobyte-9f33c3a3-c81c-4879-882e-fdb28ad61f62" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] Deleting offline snapshot 9f33c3a3-c81c-4879-882e-fdb28ad61f62 of volume a98e67a8-d43f-4b21-bec5-fac536d771fd {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] snapshot_file for this snap is: volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4679dc-4f1b-452c-b965-4e44400f7c42]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:27 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6 1G" returned: 0 in 0.527s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:27 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6 Sep 17 15:16:27 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:27 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62 Sep 17 15:16:27 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:27 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6" returned: 0 in 0.316s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:27 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6 is being set with open permissions: ugo+rw Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:27 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6 Sep 17 15:16:27 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:27 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62" returned: 0 in 0.403s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a98e67a8-d43f-4b21-bec5-fac536d771fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c38ad9d-1b04-4332-8e60-a914202467e7]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:28 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd Sep 17 15:16:28 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:28 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6" returned: 0 in 0.332s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=244,cinder:UPDATE=300,cinder:INSERT=88,cinder:DELETE=28 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=328,cinder:SELECT=219,cinder:DELETE=29,cinder:INSERT=80 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:28 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.info Sep 17 15:16:28 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Flow 'volume_create_manager' (3de5a890-9b94-4d72-8ef4-e9f844fda410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93819698-b24e-436d-bb51-362ecb804b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93819698-b24e-436d-bb51-362ecb804b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1315423592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0e36e1-df21-4598-b35b-5e50fd02343c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3043b85614994b1a89a5114413ff6c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:28Z,use_quota=True,user_id='88dfc83a8a2642c1821329c674cdb32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820466d5-f4c8-4c3c-a873-be60723569bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820466d5-f4c8-4c3c-a873-be60723569bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6059a40-08e7-4e2b-8ab0-9c4f10499995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6059a40-08e7-4e2b-8ab0-9c4f10499995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a0e36e1-df21-4598-b35b-5e50fd02343c', 'volume_name': 'volume-6a0e36e1-df21-4598-b35b-5e50fd02343c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030665f9-bb05-4199-9816-d2a7679162a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030665f9-bb05-4199-9816-d2a7679162a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7990039-2a6f-4b11-900a-3f4c04c1bbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:28 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Volume 6a0e36e1-df21-4598-b35b-5e50fd02343c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a0e36e1-df21-4598-b35b-5e50fd02343c', 'volume_size': 1} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:28 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd" returned: 0 in 0.488s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:28 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62 Sep 17 15:16:28 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:28 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.info" returned: 0 in 0.336s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:28 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.info is being set with open permissions: ugo+rw Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:28 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.info Sep 17 15:16:28 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:28 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.info" returned: 0 in 0.282s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:28 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.336s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.475s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1315423592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0e36e1-df21-4598-b35b-5e50fd02343c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3043b85614994b1a89a5114413ff6c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:28Z,use_quota=True,user_id='88dfc83a8a2642c1821329c674cdb32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Creating volume 6a0e36e1-df21-4598-b35b-5e50fd02343c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:28 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62" returned: 0 in 0.442s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:28 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c 1073741824 Sep 17 15:16:28 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:28 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62 Sep 17 15:16:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-06f8c7f9-b2ef-419c-852e-f168ae0a89cd tempest-ProjectReaderTests-1757589202 None] Create snapshot completed successfully Sep 17 15:16:28 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:29 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd.9f33c3a3-c81c-4879-882e-fdb28ad61f62" returned: 0 in 0.282s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] Lock "cinder-quobyte-9f33c3a3-c81c-4879-882e-fdb28ad61f62" released by "_delete_snapshot" :: held 1.754s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] Lock "cinder-quobyte-a98e67a8-d43f-4b21-bec5-fac536d771fd" released by "delete_snapshot" :: held 1.781s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] Created reservations ['e98faaa2-1bea-4edb-ae1e-d23f379705a4', '526756d3-01cb-4978-879c-ba6d7c2afbc5', 'e5898500-0729-4c92-82ee-8cf2e3059d96', '9fb17668-9d38-4688-aeff-1bf32620424e'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] Delete snapshot completed successfully. Sep 17 15:16:29 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c 1073741824" returned: 0 in 0.482s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e22f603e-1ec6-49ed-900a-87318c1faeb4 tempest-CinderUnicodeTest-834048033 None] Lock "cinder-9f33c3a3-c81c-4879-882e-fdb28ad61f62-delete_snapshot" released by "delete_snapshot" :: held 1.920s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:29 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c Sep 17 15:16:29 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] Acquiring lock "cinder-a98e67a8-d43f-4b21-bec5-fac536d771fd-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-e795aaed-a513-4ea4-ab9d-5876de11f4a6-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] Lock "cinder-a98e67a8-d43f-4b21-bec5-fac536d771fd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] Lock "cinder-e795aaed-a513-4ea4-ab9d-5876de11f4a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-quobyte-40b3392e-f273-48d1-9d9f-6d474aa6d8a1" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:29 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-40b3392e-f273-48d1-9d9f-6d474aa6d8a1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-quobyte-e795aaed-a513-4ea4-ab9d-5876de11f4a6" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c" returned: 0 in 0.285s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] Acquiring lock "cinder-quobyte-a98e67a8-d43f-4b21-bec5-fac536d771fd" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-e795aaed-a513-4ea4-ab9d-5876de11f4a6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] Deleting offline snapshot e795aaed-a513-4ea4-ab9d-5876de11f4a6 of volume 40b3392e-f273-48d1-9d9f-6d474aa6d8a1 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] snapshot_file for this snap is: volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7990039-2a6f-4b11-900a-3f4c04c1bbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a0e36e1-df21-4598-b35b-5e50fd02343c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff337c2-de7f-4023-bf85-17b87920f623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b348ef-4805-460e-9ea6-71e9d3c50da6]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] Lock "cinder-quobyte-a98e67a8-d43f-4b21-bec5-fac536d771fd" acquired by "delete_volume" :: waited 0.060s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:29 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Volume volume-6a0e36e1-df21-4598-b35b-5e50fd02343c (6a0e36e1-df21-4598-b35b-5e50fd02343c): created successfully Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff337c2-de7f-4023-bf85-17b87920f623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Flow 'volume_create_manager' (3de5a890-9b94-4d72-8ef4-e9f844fda410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[325a4e30-a2d4-417b-a45a-d06834ef1415]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9a4948a0-6bc6-413f-accb-967fb05783b3 tempest-ProjectMemberTests-1513431654 None] Created volume successfully. Sep 17 15:16:29 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6 Sep 17 15:16:29 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:29 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd Sep 17 15:16:29 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:30 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6" returned: 0 in 0.360s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84f2a34-c2c8-4266-98cd-021a520d2df0]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:30 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd" returned: 0 in 0.413s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:30 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd Sep 17 15:16:30 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:30 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1 Sep 17 15:16:30 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:30 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-a98e67a8-d43f-4b21-bec5-fac536d771fd" returned: 0 in 0.326s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:30 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1" returned: 0 in 0.448s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] Lock "cinder-quobyte-a98e67a8-d43f-4b21-bec5-fac536d771fd" released by "delete_volume" :: held 0.850s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:30 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6 Sep 17 15:16:30 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] Created reservations ['99cb41f9-777f-4a23-894a-06b07467893b', '6926c002-40bc-4d9d-8565-e5264b53f461', '949514e7-db7e-43d9-8638-243089f7e66f', '8eb959c3-8ba7-4cec-838c-f047e3a49347'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] Creating offline snapshot ba769a86-a980-4438-9de8-fc753823d031 of volume 6a0e36e1-df21-4598-b35b-5e50fd02343c {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0ec400-d98b-41cf-b91b-bdf01c8126e7]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] Acquiring lock "cinder-7db2df53-9e91-4262-8b54-e21f4ce2a121-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:30 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:30 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] Lock "cinder-7db2df53-9e91-4262-8b54-e21f4ce2a121-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] Acquiring lock "cinder-quobyte-7db2df53-9e91-4262-8b54-e21f4ce2a121" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] Lock "cinder-quobyte-7db2df53-9e91-4262-8b54-e21f4ce2a121" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c013bc8d-fff1-4e48-8081-75da82a58a96]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7db2df53-9e91-4262-8b54-e21f4ce2a121 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:31 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:31 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c Sep 17 15:16:31 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6" returned: 0 in 0.546s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:31 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6 Sep 17 15:16:31 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:31 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7db2df53-9e91-4262-8b54-e21f4ce2a121 Sep 17 15:16:31 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:31 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.420s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] Deleted volume successfully. Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-712a0a27-0672-437a-ba91-93a705bc44f3 tempest-CinderUnicodeTest-834048033 None] Lock "cinder-a98e67a8-d43f-4b21-bec5-fac536d771fd-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:31 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c" returned: 0 in 0.517s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:31 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031 1G Sep 17 15:16:31 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:31 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1.e795aaed-a513-4ea4-ab9d-5876de11f4a6" returned: 0 in 0.382s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-e795aaed-a513-4ea4-ab9d-5876de11f4a6" released by "_delete_snapshot" :: held 1.866s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-40b3392e-f273-48d1-9d9f-6d474aa6d8a1" released by "delete_snapshot" :: held 1.900s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:31 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7db2df53-9e91-4262-8b54-e21f4ce2a121" returned: 0 in 0.503s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7db2df53-9e91-4262-8b54-e21f4ce2a121 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:31 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7db2df53-9e91-4262-8b54-e21f4ce2a121 Sep 17 15:16:31 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] Created reservations ['41f836b0-4271-4d36-9987-11be6210f02a', '8ae4b938-e729-40a1-91d0-94be56be0c55', '09be9668-075c-4be2-a2b4-2a5e1ca290a5', '4d638255-0cd1-4125-b3de-73e2ccf3e38a'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] Delete snapshot completed successfully. Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a13dba4e-803a-4176-a2bf-9c3ea716a02f tempest-ProjectReaderTests-1757589202 None] Lock "cinder-e795aaed-a513-4ea4-ab9d-5876de11f4a6-delete_snapshot" released by "delete_snapshot" :: held 2.083s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-40b3392e-f273-48d1-9d9f-6d474aa6d8a1-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-40b3392e-f273-48d1-9d9f-6d474aa6d8a1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-quobyte-40b3392e-f273-48d1-9d9f-6d474aa6d8a1" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:31 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-7db2df53-9e91-4262-8b54-e21f4ce2a121" returned: 0 in 0.305s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-40b3392e-f273-48d1-9d9f-6d474aa6d8a1" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] Lock "cinder-quobyte-7db2df53-9e91-4262-8b54-e21f4ce2a121" released by "delete_volume" :: held 0.927s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:31 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c1d9fe-aa0c-473f-b2f5-3b16e437c7cb]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031 1G" returned: 0 in 0.559s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a0e36e1-df21-4598-b35b-5e50fd02343c -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:32 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a0e36e1-df21-4598-b35b-5e50fd02343c -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031 Sep 17 15:16:32 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] Created reservations ['ecfa840d-bc01-44f4-a734-d3b7a0bb5441', '849f925a-0435-41a4-818f-f1ff2460cb74', 'a8c2b7ae-4cd3-48b5-bfe0-04439faa3261', '7c664bcf-3308-4070-a20e-c32b6f106068'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:32 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1 Sep 17 15:16:32 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:32 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:32 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:32 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a0e36e1-df21-4598-b35b-5e50fd02343c -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031" returned: 0 in 0.310s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:32 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031 is being set with open permissions: ugo+rw Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:32 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031 Sep 17 15:16:32 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:32 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1" returned: 0 in 0.410s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:32 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1 Sep 17 15:16:32 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:32 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.315s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:32 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] Deleted volume successfully. Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d556519e-3696-4b85-bc35-65b7007a2537 tempest-CinderUnicodeTest-834048033 None] Lock "cinder-7db2df53-9e91-4262-8b54-e21f4ce2a121-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:32 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031" returned: 0 in 0.305s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:32 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-40b3392e-f273-48d1-9d9f-6d474aa6d8a1" returned: 0 in 0.289s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:32 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.info Sep 17 15:16:32 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-40b3392e-f273-48d1-9d9f-6d474aa6d8a1" released by "delete_volume" :: held 0.786s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] Created reservations ['d02a5294-46ec-4c3c-9788-d160041f6014', 'e748f10e-588e-47d1-a3aa-b9205acd3776', '42d6c1fe-27e3-46b8-8362-27862848942e', '44860330-9c15-40b3-93ff-3db9a8c98f53'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:32 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:32 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:32 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.info" returned: 0 in 0.322s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:32 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.info is being set with open permissions: ugo+rw Sep 17 15:16:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:33 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.info Sep 17 15:16:33 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:33 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.322s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] Deleted volume successfully. Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-58612555-bd67-4d22-bebd-0521c33f5525 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-40b3392e-f273-48d1-9d9f-6d474aa6d8a1-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:33 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.info" returned: 0 in 0.354s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.565s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f2bb0740-1a7b-4389-9afd-95146558585a tempest-ProjectMemberTests-1513431654 None] Create snapshot completed successfully Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Flow 'volume_create_manager' (b962c1d1-754a-4479-a122-0d5f76b80870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4f9214-ceb5-4c6a-aea7-8618dff2c428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a4f9214-ceb5-4c6a-aea7-8618dff2c428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1756994634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc817bb-9888-4966-be42-8bec3f5dcc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c18099c77804f389961048c932e3afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:34Z,use_quota=True,user_id='f582d655c48d42af88baca1cead70409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e5207a-37bd-4fde-ac06-7c4b9a4cc33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e5207a-37bd-4fde-ac06-7c4b9a4cc33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eaee329-d0ef-4a63-9797-e1cfd2b43ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eaee329-d0ef-4a63-9797-e1cfd2b43ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fc817bb-9888-4966-be42-8bec3f5dcc9d', 'volume_name': 'volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7c773a-e56a-4cbd-8d74-6bc1a9c6d9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7c773a-e56a-4cbd-8d74-6bc1a9c6d9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1ae01b-8b67-412a-8b5d-fea7f6b80de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:33 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Volume 8fc817bb-9888-4966-be42-8bec3f5dcc9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d', 'volume_size': 1} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1756994634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc817bb-9888-4966-be42-8bec3f5dcc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c18099c77804f389961048c932e3afa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:34Z,use_quota=True,user_id='f582d655c48d42af88baca1cead70409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Creating volume 8fc817bb-9888-4966-be42-8bec3f5dcc9d {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:33 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:16:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:33 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d 1073741824 Sep 17 15:16:33 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-ba769a86-a980-4438-9de8-fc753823d031-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] Lock "cinder-ba769a86-a980-4438-9de8-fc753823d031-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-6a0e36e1-df21-4598-b35b-5e50fd02343c" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-6a0e36e1-df21-4598-b35b-5e50fd02343c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-ba769a86-a980-4438-9de8-fc753823d031" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-ba769a86-a980-4438-9de8-fc753823d031" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] Deleting offline snapshot ba769a86-a980-4438-9de8-fc753823d031 of volume 6a0e36e1-df21-4598-b35b-5e50fd02343c {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] snapshot_file for this snap is: volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[54659e8e-f396-44dc-811b-9778d3064d9d]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:34 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031 Sep 17 15:16:34 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:34 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d 1073741824" returned: 0 in 0.627s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:34 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d Sep 17 15:16:34 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:34 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031" returned: 0 in 0.504s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a0e36e1-df21-4598-b35b-5e50fd02343c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[76260800-69ac-41ab-b608-e9fc57c7fbb4]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:34 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c Sep 17 15:16:34 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:34 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d" returned: 0 in 0.406s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1ae01b-8b67-412a-8b5d-fea7f6b80de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a0c63d-924c-4c47-a929-2c3bc8f456ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:34 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Volume volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d (8fc817bb-9888-4966-be42-8bec3f5dcc9d): created successfully Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a0c63d-924c-4c47-a929-2c3bc8f456ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Flow 'volume_create_manager' (b962c1d1-754a-4479-a122-0d5f76b80870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:34 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-372bacee-a045-484b-afce-34fc248191c6 tempest-ProjectReaderTests-1757589202 None] Created volume successfully. Sep 17 15:16:35 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c" returned: 0 in 0.427s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:35 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031 Sep 17 15:16:35 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:35 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031" returned: 0 in 0.386s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:35 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031 Sep 17 15:16:35 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:35 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c.ba769a86-a980-4438-9de8-fc753823d031" returned: 0 in 0.294s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-ba769a86-a980-4438-9de8-fc753823d031" released by "_delete_snapshot" :: held 1.774s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-6a0e36e1-df21-4598-b35b-5e50fd02343c" released by "delete_snapshot" :: held 1.806s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:35 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] Created reservations ['b24a6a58-9e1b-4e02-b518-60ebafab426f', '4bdc8b97-2722-46c0-84b9-5a1f027a63eb', '7fad939f-2c91-42c0-b15c-0c27c8d4a730', '45e91bd9-8cb0-4473-9f59-2ec24cb59dfa'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] Creating offline snapshot 7cbded0f-86b7-43f6-a8f1-e700e02bdc5d of volume 8fc817bb-9888-4966-be42-8bec3f5dcc9d {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:16:36 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c83998c-68f2-48fa-9a09-b4a896952fa8]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:36 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] Delete snapshot completed successfully. Sep 17 15:16:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65927f66-214a-4d0a-a8c9-4054d3a5324a tempest-ProjectMemberTests-1513431654 None] Lock "cinder-ba769a86-a980-4438-9de8-fc753823d031-delete_snapshot" released by "delete_snapshot" :: held 2.046s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:36 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d Sep 17 15:16:36 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-6a0e36e1-df21-4598-b35b-5e50fd02343c-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-6a0e36e1-df21-4598-b35b-5e50fd02343c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-6a0e36e1-df21-4598-b35b-5e50fd02343c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-6a0e36e1-df21-4598-b35b-5e50fd02343c" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:36 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0de715b-bcd3-4e5a-9725-eca897aeb8e3]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:36 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d" returned: 0 in 0.569s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:36 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c Sep 17 15:16:36 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:36 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d 1G Sep 17 15:16:36 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:36 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c" returned: 0 in 0.542s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:36 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c Sep 17 15:16:36 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a2058947-0f32-4fa0-99b6-9d9b0b993caf tempest-ProjectAdminTests-940355001 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8068466186523, 'free_capacity_gb': 1775.8068466186523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86082) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 17 15:16:37 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d 1G" returned: 0 in 0.539s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:37 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d Sep 17 15:16:37 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:37 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-6a0e36e1-df21-4598-b35b-5e50fd02343c" returned: 0 in 0.337s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-6a0e36e1-df21-4598-b35b-5e50fd02343c" released by "delete_volume" :: held 0.978s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] Created reservations ['ed311677-2264-4002-862b-92b41b08dba0', '48fd275b-bab3-4014-8d3c-2036d35a2640', '19093fe8-4c6b-445d-9d72-386c2bd42b8c', '237c1b6a-26c7-469b-985f-111315a356a2'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:37 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:37 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:37 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d" returned: 0 in 0.410s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:37 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d is being set with open permissions: ugo+rw Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:37 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d Sep 17 15:16:37 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:37 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.317s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] Deleted volume successfully. Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e7e7e04b-e06d-4d82-8f98-b2d367f9b545 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-6a0e36e1-df21-4598-b35b-5e50fd02343c-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:37 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d" returned: 0 in 0.330s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:37 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.info Sep 17 15:16:37 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:38 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.info" returned: 0 in 0.302s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:38 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.info is being set with open permissions: ugo+rw Sep 17 15:16:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:38 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.info Sep 17 15:16:38 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:38 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.info" returned: 0 in 0.312s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.576s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:38 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-264b40f7-5a2d-4c04-89d9-1fee9d520445 tempest-ProjectReaderTests-1757589202 None] Create snapshot completed successfully Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Flow 'volume_create_manager' (35f025ee-f470-4f21-bca8-a8bd933a86b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915e0f10-a082-44d3-822d-c1138cbe14d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (915e0f10-a082-44d3-822d-c1138cbe14d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1874495074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1465898e-605f-49de-a39b-6ce5c5fdd664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3043b85614994b1a89a5114413ff6c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:39Z,use_quota=True,user_id='88dfc83a8a2642c1821329c674cdb32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d26b83-019f-4231-b2d1-0ffdc98315c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d26b83-019f-4231-b2d1-0ffdc98315c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a64bd3-3756-4d13-a8b3-4f82a4281b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a64bd3-3756-4d13-a8b3-4f82a4281b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1465898e-605f-49de-a39b-6ce5c5fdd664', 'volume_name': 'volume-1465898e-605f-49de-a39b-6ce5c5fdd664', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6418f925-c98d-4631-889d-7cf897e3035a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6418f925-c98d-4631-889d-7cf897e3035a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1395732d-9326-416f-a7fd-13373523f306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:39 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Volume 1465898e-605f-49de-a39b-6ce5c5fdd664: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1465898e-605f-49de-a39b-6ce5c5fdd664', 'volume_size': 1} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1874495074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1465898e-605f-49de-a39b-6ce5c5fdd664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3043b85614994b1a89a5114413ff6c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:39Z,use_quota=True,user_id='88dfc83a8a2642c1821329c674cdb32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Creating volume 1465898e-605f-49de-a39b-6ce5c5fdd664 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:39 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-7cbded0f-86b7-43f6-a8f1-e700e02bdc5d-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:39 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664 1073741824 Sep 17 15:16:39 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-7cbded0f-86b7-43f6-a8f1-e700e02bdc5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-quobyte-8fc817bb-9888-4966-be42-8bec3f5dcc9d" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-8fc817bb-9888-4966-be42-8bec3f5dcc9d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-quobyte-7cbded0f-86b7-43f6-a8f1-e700e02bdc5d" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-7cbded0f-86b7-43f6-a8f1-e700e02bdc5d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] Deleting offline snapshot 7cbded0f-86b7-43f6-a8f1-e700e02bdc5d of volume 8fc817bb-9888-4966-be42-8bec3f5dcc9d {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] snapshot_file for this snap is: volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4183648c-9596-4a50-a90c-5b8ef590c2e7]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:39 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d Sep 17 15:16:39 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:39 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d" returned: 0 in 0.471s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:16:39 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664 1073741824" returned: 0 in 0.660s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd671e34-c9c1-468e-b438-8b478e471202]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:39 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664 Sep 17 15:16:39 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:40 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d Sep 17 15:16:40 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:40 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664" returned: 0 in 0.300s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1395732d-9326-416f-a7fd-13373523f306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1465898e-605f-49de-a39b-6ce5c5fdd664', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff981cfa-3f97-4297-a17c-e3af1f6aa092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:40 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Volume volume-1465898e-605f-49de-a39b-6ce5c5fdd664 (1465898e-605f-49de-a39b-6ce5c5fdd664): created successfully Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff981cfa-3f97-4297-a17c-e3af1f6aa092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Flow 'volume_create_manager' (35f025ee-f470-4f21-bca8-a8bd933a86b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:40 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-760ab629-74e7-48a2-ae65-2fa3b2a4791b tempest-ProjectMemberTests-1513431654 None] Created volume successfully. Sep 17 15:16:40 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d" returned: 0 in 0.446s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:40 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d Sep 17 15:16:40 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:40 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:40 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:40 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d" returned: 0 in 0.503s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:40 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.433s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:16:40 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d Sep 17 15:16:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:16:40 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:41 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d.7cbded0f-86b7-43f6-a8f1-e700e02bdc5d" returned: 0 in 0.272s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-7cbded0f-86b7-43f6-a8f1-e700e02bdc5d" released by "_delete_snapshot" :: held 1.837s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-8fc817bb-9888-4966-be42-8bec3f5dcc9d" released by "delete_snapshot" :: held 1.861s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:41 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] Created reservations ['63e75a7d-9189-46f9-a23c-a98143776f6c', '5582a867-4405-4fa4-bbd0-1bc663721d6d', 'a12b4b4d-b736-4774-95c6-a1af89aa93bf', 'f92c231e-e321-45d4-b334-ab341514450d'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] Delete snapshot completed successfully. Sep 17 15:16:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d58f76e3-27f9-47f9-8b1d-92d6a1f2b2e7 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-7cbded0f-86b7-43f6-a8f1-e700e02bdc5d-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-8fc817bb-9888-4966-be42-8bec3f5dcc9d-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] Creating offline snapshot db8890a7-f9a9-4a3e-860e-364c90d12720 of volume 1465898e-605f-49de-a39b-6ce5c5fdd664 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:16:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-8fc817bb-9888-4966-be42-8bec3f5dcc9d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:41 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[040ff702-fe84-41b7-a54b-0b774230c589]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "cinder-quobyte-8fc817bb-9888-4966-be42-8bec3f5dcc9d" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-8fc817bb-9888-4966-be42-8bec3f5dcc9d" acquired by "delete_volume" :: waited 0.033s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:41 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664 Sep 17 15:16:41 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:41 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04a8ea2-7f6b-438f-a1bb-509f78aab0a2]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:41 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d Sep 17 15:16:41 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:41 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664" returned: 0 in 0.419s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:41 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720 1G Sep 17 15:16:41 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:42 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d" returned: 0 in 0.409s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:42 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d Sep 17 15:16:42 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:42 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-8fc817bb-9888-4966-be42-8bec3f5dcc9d" returned: 0 in 0.284s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:42 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720 1G" returned: 0 in 0.458s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1465898e-605f-49de-a39b-6ce5c5fdd664 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-quobyte-8fc817bb-9888-4966-be42-8bec3f5dcc9d" released by "delete_volume" :: held 0.804s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:42 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1465898e-605f-49de-a39b-6ce5c5fdd664 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720 Sep 17 15:16:42 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] Created reservations ['47b05787-28c2-4e41-909d-47c06b1c5188', '1deee107-9243-4475-96ae-9951c19d2a67', 'ffc005bd-885e-44b9-bc38-b52b4cdeaafd', '344c6358-94df-43e5-98d3-2a7914f54be8'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:42 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:42 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:42 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1465898e-605f-49de-a39b-6ce5c5fdd664 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720" returned: 0 in 0.331s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:42 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720 is being set with open permissions: ugo+rw Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:42 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720 Sep 17 15:16:42 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:42 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.277s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:42 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] Deleted volume successfully. Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0bfa5b00-27d8-4c0f-9ec4-195be4c8efe9 tempest-ProjectReaderTests-1757589202 None] Lock "cinder-8fc817bb-9888-4966-be42-8bec3f5dcc9d-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:42 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720" returned: 0 in 0.276s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:43 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.info Sep 17 15:16:43 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:43 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.info" returned: 0 in 0.274s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:43 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.info is being set with open permissions: ugo+rw Sep 17 15:16:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:43 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.info Sep 17 15:16:43 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:43 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.info" returned: 0 in 0.276s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:43 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a644daea-79b5-4bcd-935f-48f4ca397676 tempest-ProjectMemberTests-1513431654 None] Create snapshot completed successfully Sep 17 15:16:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-db8890a7-f9a9-4a3e-860e-364c90d12720-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-db8890a7-f9a9-4a3e-860e-364c90d12720-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-1465898e-605f-49de-a39b-6ce5c5fdd664" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-1465898e-605f-49de-a39b-6ce5c5fdd664" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-db8890a7-f9a9-4a3e-860e-364c90d12720" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-db8890a7-f9a9-4a3e-860e-364c90d12720" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] Deleting offline snapshot db8890a7-f9a9-4a3e-860e-364c90d12720 of volume 1465898e-605f-49de-a39b-6ce5c5fdd664 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:16:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] snapshot_file for this snap is: volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:16:44 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e5fda7-f01e-4efb-9f1f-45e3aa618dce]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:44 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720 Sep 17 15:16:44 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:45 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720" returned: 0 in 0.394s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1465898e-605f-49de-a39b-6ce5c5fdd664(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:16:45 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41eef44-68d7-43c8-9903-dc329821503d]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:45 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664 Sep 17 15:16:45 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:45 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664" returned: 0 in 0.402s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:45 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720 Sep 17 15:16:45 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:45 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720" returned: 0 in 0.390s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:45 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720 Sep 17 15:16:45 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:46 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664.db8890a7-f9a9-4a3e-860e-364c90d12720" returned: 0 in 0.271s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-db8890a7-f9a9-4a3e-860e-364c90d12720" released by "_delete_snapshot" :: held 1.597s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-1465898e-605f-49de-a39b-6ce5c5fdd664" released by "delete_snapshot" :: held 1.621s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:46 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] Created reservations ['07021127-2179-49f5-aada-e175359ba945', 'ea8b7e8e-fe89-4d9a-a260-01477b609369', '2f9321d4-0ff5-451c-b106-8860120d5385', '94447fae-4ef1-46fe-968d-29413a355591'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] Delete snapshot completed successfully. Sep 17 15:16:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bd0d9a3e-9692-42e3-93a9-86fb2431c296 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-db8890a7-f9a9-4a3e-860e-364c90d12720-delete_snapshot" released by "delete_snapshot" :: held 1.768s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-1465898e-605f-49de-a39b-6ce5c5fdd664-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-1465898e-605f-49de-a39b-6ce5c5fdd664-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-1465898e-605f-49de-a39b-6ce5c5fdd664" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-1465898e-605f-49de-a39b-6ce5c5fdd664" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:46 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f3728b-60a1-4f26-bbfa-9d5803fa48c7]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:47 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664 Sep 17 15:16:47 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:47 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664" returned: 0 in 0.378s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:47 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664 Sep 17 15:16:47 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:47 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-1465898e-605f-49de-a39b-6ce5c5fdd664" returned: 0 in 0.257s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-1465898e-605f-49de-a39b-6ce5c5fdd664" released by "delete_volume" :: held 0.700s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:47 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] Created reservations ['42f703a0-1aee-48b2-a15d-0260fdca1dc8', 'eb14eeff-262e-43a0-a991-7a2701b354a4', 'ee58004a-5038-49e1-b524-7e7f0dbf76fb', '6af20af0-c759-4f88-b48d-806b27d00736'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:47 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:47 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:47 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:48 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] Deleted volume successfully. Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-269eef0d-cc28-4fd9-85f3-76a69376a193 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-1465898e-605f-49de-a39b-6ce5c5fdd664-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Flow 'volume_create_manager' (61c8d5a8-4fe0-4c8c-9c5c-4ea51a6b7448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8965e2-8197-4dee-815d-6bdfaca3502b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8965e2-8197-4dee-815d-6bdfaca3502b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1352552263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff753797-71b6-413c-b5e3-efebe6805de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3043b85614994b1a89a5114413ff6c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:48Z,use_quota=True,user_id='88dfc83a8a2642c1821329c674cdb32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b4c2af-016d-4da3-afc5-f955270983ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b4c2af-016d-4da3-afc5-f955270983ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a32733-20dd-4f9f-b2b7-12f8263ac903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a32733-20dd-4f9f-b2b7-12f8263ac903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff753797-71b6-413c-b5e3-efebe6805de5', 'volume_name': 'volume-ff753797-71b6-413c-b5e3-efebe6805de5', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58938081-4d9c-486b-8935-0356884decdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58938081-4d9c-486b-8935-0356884decdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bde22f8-1896-4cf8-8488-462dada374c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:48 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Volume ff753797-71b6-413c-b5e3-efebe6805de5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff753797-71b6-413c-b5e3-efebe6805de5', 'volume_size': 1} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1352552263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff753797-71b6-413c-b5e3-efebe6805de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3043b85614994b1a89a5114413ff6c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:48Z,use_quota=True,user_id='88dfc83a8a2642c1821329c674cdb32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Creating volume ff753797-71b6-413c-b5e3-efebe6805de5 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:48 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:16:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:48 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5 1073741824 Sep 17 15:16:48 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:49 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5 1073741824" returned: 0 in 0.487s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:49 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5 Sep 17 15:16:49 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:49 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5" returned: 0 in 0.257s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bde22f8-1896-4cf8-8488-462dada374c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff753797-71b6-413c-b5e3-efebe6805de5', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd45debc-5588-45b7-b827-dba5f3ada120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:49 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Volume volume-ff753797-71b6-413c-b5e3-efebe6805de5 (ff753797-71b6-413c-b5e3-efebe6805de5): created successfully Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd45debc-5588-45b7-b827-dba5f3ada120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Flow 'volume_create_manager' (61c8d5a8-4fe0-4c8c-9c5c-4ea51a6b7448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:49 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1f7be040-6ef5-40a4-a7d9-ee79ea31b959 tempest-ProjectMemberTests-1513431654 None] Created volume successfully. Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Flow 'volume_create_manager' (f4fecf03-da7c-412e-a5dd-79e1e973d178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e53934-d51f-4702-ae35-4ef9a0852f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e53934-d51f-4702-ae35-4ef9a0852f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-881109353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e87a95b0-9dc1-4e9a-83f0-079dae6caede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0c90156f2ca4ed396ebde3330189f2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:50Z,use_quota=True,user_id='8c94e86228184785a8d49e561fac547d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524cdc8e-17e8-438c-b7ae-624bf3305bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524cdc8e-17e8-438c-b7ae-624bf3305bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b83c85-4416-4d62-a5ed-2f0cf445af2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b83c85-4416-4d62-a5ed-2f0cf445af2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e87a95b0-9dc1-4e9a-83f0-079dae6caede', 'volume_name': 'volume-e87a95b0-9dc1-4e9a-83f0-079dae6caede', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199444cf-1a20-4387-95d0-66b1f4652fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199444cf-1a20-4387-95d0-66b1f4652fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd2b4ca-5f0c-48b4-9e81-b624598673de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:49 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Volume e87a95b0-9dc1-4e9a-83f0-079dae6caede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e87a95b0-9dc1-4e9a-83f0-079dae6caede', 'volume_size': 1} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-881109353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e87a95b0-9dc1-4e9a-83f0-079dae6caede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0c90156f2ca4ed396ebde3330189f2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:50Z,use_quota=True,user_id='8c94e86228184785a8d49e561fac547d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Creating volume e87a95b0-9dc1-4e9a-83f0-079dae6caede {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:49 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:16:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e87a95b0-9dc1-4e9a-83f0-079dae6caede 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:49 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e87a95b0-9dc1-4e9a-83f0-079dae6caede 1073741824 Sep 17 15:16:49 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:50 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e87a95b0-9dc1-4e9a-83f0-079dae6caede 1073741824" returned: 0 in 0.431s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e87a95b0-9dc1-4e9a-83f0-079dae6caede {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:50 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e87a95b0-9dc1-4e9a-83f0-079dae6caede Sep 17 15:16:50 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:50 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e87a95b0-9dc1-4e9a-83f0-079dae6caede" returned: 0 in 0.276s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd2b4ca-5f0c-48b4-9e81-b624598673de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e87a95b0-9dc1-4e9a-83f0-079dae6caede', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d783d2-42fe-45f5-872c-66b8cf0cec32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:50 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Volume volume-e87a95b0-9dc1-4e9a-83f0-079dae6caede (e87a95b0-9dc1-4e9a-83f0-079dae6caede): created successfully Sep 17 15:16:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d783d2-42fe-45f5-872c-66b8cf0cec32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Flow 'volume_create_manager' (f4fecf03-da7c-412e-a5dd-79e1e973d178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-da189eee-d467-4af0-89d7-6ac2d32e1c6c tempest-ProjectReaderTests-441495387 None] Created volume successfully. Sep 17 15:16:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] Creating offline snapshot ebcc2fef-d9e3-421f-9a7d-691ee04c312e of volume ff753797-71b6-413c-b5e3-efebe6805de5 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:16:50 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c759db5-f13a-48b0-82d2-528da5ffe63c]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:50 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5 Sep 17 15:16:50 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] Acquiring lock "cinder-e87a95b0-9dc1-4e9a-83f0-079dae6caede-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] Lock "cinder-e87a95b0-9dc1-4e9a-83f0-079dae6caede-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] Acquiring lock "cinder-quobyte-e87a95b0-9dc1-4e9a-83f0-079dae6caede" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] Lock "cinder-quobyte-e87a95b0-9dc1-4e9a-83f0-079dae6caede" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8234acf4-8906-43f0-ac1a-4a83b03062a1]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e87a95b0-9dc1-4e9a-83f0-079dae6caede {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:51 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5" returned: 0 in 0.407s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:51 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e 1G Sep 17 15:16:51 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:51 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e87a95b0-9dc1-4e9a-83f0-079dae6caede Sep 17 15:16:51 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:51 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e87a95b0-9dc1-4e9a-83f0-079dae6caede" returned: 0 in 0.405s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e87a95b0-9dc1-4e9a-83f0-079dae6caede {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:51 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e87a95b0-9dc1-4e9a-83f0-079dae6caede Sep 17 15:16:51 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:51 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e 1G" returned: 0 in 0.448s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff753797-71b6-413c-b5e3-efebe6805de5 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:51 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff753797-71b6-413c-b5e3-efebe6805de5 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e Sep 17 15:16:51 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:51 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-e87a95b0-9dc1-4e9a-83f0-079dae6caede" returned: 0 in 0.261s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] Lock "cinder-quobyte-e87a95b0-9dc1-4e9a-83f0-079dae6caede" released by "delete_volume" :: held 0.707s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] Created reservations ['851b4490-c05b-4532-86ed-ed8247b44e4d', '2cebc15c-e55d-4c07-843a-e7d644f8df93', '5681d5db-4e18-4309-9473-7aba76cf0d40', '3c4b9684-8662-4445-bacc-f93d8cef2a93'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:52 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:52 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:52 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff753797-71b6-413c-b5e3-efebe6805de5 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e" returned: 0 in 0.350s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:52 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e is being set with open permissions: ugo+rw Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:52 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e Sep 17 15:16:52 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:52 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.275s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] Deleted volume successfully. Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-afb15a76-4491-4186-acc9-bf05107c2e63 tempest-ProjectReaderTests-441495387 None] Lock "cinder-e87a95b0-9dc1-4e9a-83f0-079dae6caede-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:52 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e" returned: 0 in 0.291s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:52 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.info Sep 17 15:16:52 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:52 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.info" returned: 0 in 0.312s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:52 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.info is being set with open permissions: ugo+rw Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:52 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.info Sep 17 15:16:52 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Flow 'volume_create_manager' (6e2f9c61-9a77-44a1-abc3-caebe54a8808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e06387-d091-4414-b8b5-aae8e5d4729b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e06387-d091-4414-b8b5-aae8e5d4729b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1891916588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a52d659-52e2-433e-ad29-be6c9b283894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0c90156f2ca4ed396ebde3330189f2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:53Z,use_quota=True,user_id='8c94e86228184785a8d49e561fac547d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb8f0e3-cbe9-4530-aa69-dcf334b5a121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb8f0e3-cbe9-4530-aa69-dcf334b5a121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e9eccc-2cf3-4f27-9a9f-c5a36a682415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e9eccc-2cf3-4f27-9a9f-c5a36a682415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a52d659-52e2-433e-ad29-be6c9b283894', 'volume_name': 'volume-4a52d659-52e2-433e-ad29-be6c9b283894', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419fe030-add1-40c2-8ca8-935beba29cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419fe030-add1-40c2-8ca8-935beba29cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c8ec94f-04fa-435e-a2f2-ef49a0a8a3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:52 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Volume 4a52d659-52e2-433e-ad29-be6c9b283894: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a52d659-52e2-433e-ad29-be6c9b283894', 'volume_size': 1} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:52 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.info" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.171s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.074s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1891916588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a52d659-52e2-433e-ad29-be6c9b283894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0c90156f2ca4ed396ebde3330189f2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:53Z,use_quota=True,user_id='8c94e86228184785a8d49e561fac547d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Creating volume 4a52d659-52e2-433e-ad29-be6c9b283894 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:52 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:16:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4a52d659-52e2-433e-ad29-be6c9b283894 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:52 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4a52d659-52e2-433e-ad29-be6c9b283894 1073741824 Sep 17 15:16:52 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-508d3361-5719-4ee4-bc46-9bbd87d2c442 tempest-ProjectMemberTests-1513431654 None] Create snapshot completed successfully Sep 17 15:16:53 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4a52d659-52e2-433e-ad29-be6c9b283894 1073741824" returned: 0 in 0.414s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4a52d659-52e2-433e-ad29-be6c9b283894 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:53 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4a52d659-52e2-433e-ad29-be6c9b283894 Sep 17 15:16:53 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:53 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4a52d659-52e2-433e-ad29-be6c9b283894" returned: 0 in 0.264s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c8ec94f-04fa-435e-a2f2-ef49a0a8a3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a52d659-52e2-433e-ad29-be6c9b283894', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb223329-9952-4ac1-ba9f-172058467734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:53 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Volume volume-4a52d659-52e2-433e-ad29-be6c9b283894 (4a52d659-52e2-433e-ad29-be6c9b283894): created successfully Sep 17 15:16:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb223329-9952-4ac1-ba9f-172058467734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Flow 'volume_create_manager' (6e2f9c61-9a77-44a1-abc3-caebe54a8808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-46674cf6-0b54-41d0-9530-7101b40cc7f9 tempest-ProjectReaderTests-441495387 None] Created volume successfully. Sep 17 15:16:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-ebcc2fef-d9e3-421f-9a7d-691ee04c312e-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] Lock "cinder-ebcc2fef-d9e3-421f-9a7d-691ee04c312e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-ff753797-71b6-413c-b5e3-efebe6805de5" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-ff753797-71b6-413c-b5e3-efebe6805de5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-ebcc2fef-d9e3-421f-9a7d-691ee04c312e" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-ebcc2fef-d9e3-421f-9a7d-691ee04c312e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] Deleting offline snapshot ebcc2fef-d9e3-421f-9a7d-691ee04c312e of volume ff753797-71b6-413c-b5e3-efebe6805de5 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:16:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] snapshot_file for this snap is: volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:16:54 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cef484-a01d-487c-9d4d-e4492b364c0e]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:54 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e Sep 17 15:16:54 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:54 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e" returned: 0 in 0.379s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff753797-71b6-413c-b5e3-efebe6805de5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:16:54 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86ba7d5-a842-4e57-a91c-6c2e2f690752]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:54 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5 Sep 17 15:16:54 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:54 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5" returned: 0 in 0.405s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] Acquiring lock "cinder-4a52d659-52e2-433e-ad29-be6c9b283894-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:54 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e Sep 17 15:16:54 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] Lock "cinder-4a52d659-52e2-433e-ad29-be6c9b283894-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] Acquiring lock "cinder-quobyte-4a52d659-52e2-433e-ad29-be6c9b283894" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] Lock "cinder-quobyte-4a52d659-52e2-433e-ad29-be6c9b283894" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e3a73a-fee5-41c3-bccc-fa2113f3317c]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4a52d659-52e2-433e-ad29-be6c9b283894 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:55 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4a52d659-52e2-433e-ad29-be6c9b283894 Sep 17 15:16:55 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:55 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e" returned: 0 in 0.426s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:55 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e Sep 17 15:16:55 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:55 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4a52d659-52e2-433e-ad29-be6c9b283894" returned: 0 in 0.422s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4a52d659-52e2-433e-ad29-be6c9b283894 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:55 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4a52d659-52e2-433e-ad29-be6c9b283894 Sep 17 15:16:55 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:55 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5.ebcc2fef-d9e3-421f-9a7d-691ee04c312e" returned: 0 in 0.285s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-ebcc2fef-d9e3-421f-9a7d-691ee04c312e" released by "_delete_snapshot" :: held 1.637s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-ff753797-71b6-413c-b5e3-efebe6805de5" released by "delete_snapshot" :: held 1.664s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] Created reservations ['17fc4d14-5da4-4d4d-9aa9-a76e7d7f64aa', '4d67f290-363b-4104-ba89-4c53d2912a1d', '5a60382b-34bb-4c98-8ca6-f68573945048', 'd6f1ba75-88fb-494c-8245-61a668263b7b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:55 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-4a52d659-52e2-433e-ad29-be6c9b283894" returned: 0 in 0.295s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] Lock "cinder-quobyte-4a52d659-52e2-433e-ad29-be6c9b283894" released by "delete_volume" :: held 0.786s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] Delete snapshot completed successfully. Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-76bad3de-0dc3-4cdf-b020-b51d9c6aaece tempest-ProjectMemberTests-1513431654 None] Lock "cinder-ebcc2fef-d9e3-421f-9a7d-691ee04c312e-delete_snapshot" released by "delete_snapshot" :: held 1.855s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] Created reservations ['4683dc07-6741-4306-8be5-663defa239db', '20d3f5fa-063b-48cb-a720-aae5bd3c8cee', '1e10039d-75d4-4874-a02d-1a454a110ea4', '97a96265-eda5-4f85-ac98-94d82a7202ed'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:55 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:55 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-ff753797-71b6-413c-b5e3-efebe6805de5-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-ff753797-71b6-413c-b5e3-efebe6805de5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-ff753797-71b6-413c-b5e3-efebe6805de5" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-ff753797-71b6-413c-b5e3-efebe6805de5" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:56 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.406s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:56 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:56 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] Deleted volume successfully. Sep 17 15:16:56 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fced53-9b39-4ebe-98a2-7e56ae64b839]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a5ee8cf0-48d5-42af-8ec1-42ddb4d15da4 tempest-ProjectReaderTests-441495387 None] Lock "cinder-4a52d659-52e2-433e-ad29-be6c9b283894-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:56 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5 Sep 17 15:16:56 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:56 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5" returned: 0 in 0.517s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:56 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5 Sep 17 15:16:56 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:57 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ff753797-71b6-413c-b5e3-efebe6805de5" returned: 0 in 0.301s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-ff753797-71b6-413c-b5e3-efebe6805de5" released by "delete_volume" :: held 0.917s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:57 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] Created reservations ['5e7a7610-3dec-4ae5-b944-f60366e33789', '0fef14ab-c98c-412e-ab7b-21652534b6f8', '8a6df4f4-3bb2-4920-9f0b-9a32ef12c5fd', '8fa44908-5f00-4c4d-9293-a7ebac7d5603'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:57 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:16:57 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:57 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.354s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:57 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] Deleted volume successfully. Sep 17 15:16:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c894e348-f089-4bf3-8936-9229e7e5f4f3 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-ff753797-71b6-413c-b5e3-efebe6805de5-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Flow 'volume_create_manager' (86e05bba-315c-41b4-9c32-97ea3acf09d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52c8d1c-4ca6-44a0-8021-995072f39f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52c8d1c-4ca6-44a0-8021-995072f39f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1737626675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5161bc21-fa82-485d-9a10-86ac21c64b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3043b85614994b1a89a5114413ff6c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:58Z,use_quota=True,user_id='88dfc83a8a2642c1821329c674cdb32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490e4296-3ab2-4d25-9332-8ba6b9e63f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490e4296-3ab2-4d25-9332-8ba6b9e63f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940144bb-4493-4e28-a8e6-9c2970d4f547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (940144bb-4493-4e28-a8e6-9c2970d4f547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5161bc21-fa82-485d-9a10-86ac21c64b69', 'volume_name': 'volume-5161bc21-fa82-485d-9a10-86ac21c64b69', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4f1b39-500c-488c-8853-84d832fa235c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4f1b39-500c-488c-8853-84d832fa235c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f20719-67b9-403e-ace9-bf38ba56b88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:58 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Volume 5161bc21-fa82-485d-9a10-86ac21c64b69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5161bc21-fa82-485d-9a10-86ac21c64b69', 'volume_size': 1} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1737626675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5161bc21-fa82-485d-9a10-86ac21c64b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3043b85614994b1a89a5114413ff6c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:58Z,use_quota=True,user_id='88dfc83a8a2642c1821329c674cdb32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Creating volume 5161bc21-fa82-485d-9a10-86ac21c64b69 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:58 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:58 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69 1073741824 Sep 17 15:16:58 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:58 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69 1073741824" returned: 0 in 0.476s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:58 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69 Sep 17 15:16:58 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:59 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69" returned: 0 in 0.274s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f20719-67b9-403e-ace9-bf38ba56b88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5161bc21-fa82-485d-9a10-86ac21c64b69', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53484764-6e5e-4507-b1ac-5dd8edbe6884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:59 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Volume volume-5161bc21-fa82-485d-9a10-86ac21c64b69 (5161bc21-fa82-485d-9a10-86ac21c64b69): created successfully Sep 17 15:16:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53484764-6e5e-4507-b1ac-5dd8edbe6884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Flow 'volume_create_manager' (86e05bba-315c-41b4-9c32-97ea3acf09d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8d7e9448-b377-4372-941b-5339898149e0 tempest-ProjectMemberTests-1513431654 None] Created volume successfully. Sep 17 15:17:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] Creating offline snapshot 6bc93b2d-efe6-49bc-879a-380776d77bdd of volume 5161bc21-fa82-485d-9a10-86ac21c64b69 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:17:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad9d308-a1e3-48b2-9c99-e8e7557785ee]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:00 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69 Sep 17 15:17:00 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:01 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69" returned: 0 in 0.406s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:01 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd 1G Sep 17 15:17:01 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:01 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd 1G" returned: 0 in 0.532s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5161bc21-fa82-485d-9a10-86ac21c64b69 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:01 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5161bc21-fa82-485d-9a10-86ac21c64b69 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd Sep 17 15:17:01 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:01 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5161bc21-fa82-485d-9a10-86ac21c64b69 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd" returned: 0 in 0.369s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:01 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd is being set with open permissions: ugo+rw Sep 17 15:17:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:01 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd Sep 17 15:17:01 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:02 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd" returned: 0 in 0.257s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:02 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.info Sep 17 15:17:02 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:02 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.info" returned: 0 in 0.288s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:02 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.info is being set with open permissions: ugo+rw Sep 17 15:17:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:02 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.info Sep 17 15:17:02 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:02 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.info" returned: 0 in 0.276s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.242s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:02 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-69dc55ff-bc50-4899-92ba-6559d0b026ff tempest-ProjectMemberTests-1513431654 None] Create snapshot completed successfully Sep 17 15:17:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-6bc93b2d-efe6-49bc-879a-380776d77bdd-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] Lock "cinder-6bc93b2d-efe6-49bc-879a-380776d77bdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-5161bc21-fa82-485d-9a10-86ac21c64b69" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-5161bc21-fa82-485d-9a10-86ac21c64b69" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-6bc93b2d-efe6-49bc-879a-380776d77bdd" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-6bc93b2d-efe6-49bc-879a-380776d77bdd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] Deleting offline snapshot 6bc93b2d-efe6-49bc-879a-380776d77bdd of volume 5161bc21-fa82-485d-9a10-86ac21c64b69 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:17:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] snapshot_file for this snap is: volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:17:03 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f809ce-007b-4e25-ac14-7de7e0804be0]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:04 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd Sep 17 15:17:04 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:04 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd" returned: 0 in 0.432s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5161bc21-fa82-485d-9a10-86ac21c64b69(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:17:04 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd25b16b-fdf5-4a52-a42f-12f10e3604f5]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:04 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69 Sep 17 15:17:04 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:04 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69" returned: 0 in 0.468s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:04 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd Sep 17 15:17:04 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:05 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd" returned: 0 in 0.354s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:05 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd Sep 17 15:17:05 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:05 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69.6bc93b2d-efe6-49bc-879a-380776d77bdd" returned: 0 in 0.270s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-6bc93b2d-efe6-49bc-879a-380776d77bdd" released by "_delete_snapshot" :: held 1.667s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-5161bc21-fa82-485d-9a10-86ac21c64b69" released by "delete_snapshot" :: held 1.696s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:05 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] Created reservations ['ed1af238-8244-45fc-b655-6fadabc0100d', '06a0109d-cc91-429d-a1f8-f6c8a7df2fa8', '14960ac9-4c5d-4aa5-901e-6945ff2d50a2', '815cdb4e-720a-4576-aca5-7c595f1cdd63'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:05 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] Delete snapshot completed successfully. Sep 17 15:17:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1390781c-5fc5-441d-b45e-563191a1a4cf tempest-ProjectMemberTests-1513431654 None] Lock "cinder-6bc93b2d-efe6-49bc-879a-380776d77bdd-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-5161bc21-fa82-485d-9a10-86ac21c64b69-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-5161bc21-fa82-485d-9a10-86ac21c64b69-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-5161bc21-fa82-485d-9a10-86ac21c64b69" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-5161bc21-fa82-485d-9a10-86ac21c64b69" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f1dd20-f309-4ee8-af1b-4b978b957a08]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:06 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69 Sep 17 15:17:06 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:06 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69" returned: 0 in 0.428s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:06 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69 Sep 17 15:17:06 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:06 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-5161bc21-fa82-485d-9a10-86ac21c64b69" returned: 0 in 0.274s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-5161bc21-fa82-485d-9a10-86ac21c64b69" released by "delete_volume" :: held 0.782s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:06 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] Created reservations ['7cbc1990-e44a-4702-931b-24f5030f5811', '08bf0b40-d796-473b-980c-90f7cc49ae65', '9a75302d-e7c8-423c-b69f-c04db10e093f', 'f4402e00-582b-4db8-a388-a658581084e0'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:07 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:17:07 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:07 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.269s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] Deleted volume successfully. Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f54de8a5-4fd2-4929-a0a1-30edae88d212 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-5161bc21-fa82-485d-9a10-86ac21c64b69-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Flow 'volume_create_manager' (58b2cb92-52bc-46d2-81f2-f1fbfba4ce49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaaf261f-e5fd-4795-894a-815f22b0cfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaaf261f-e5fd-4795-894a-815f22b0cfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-198943059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f20c6c54-87f1-4ea1-9022-e5fefbe4eb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3043b85614994b1a89a5114413ff6c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:08Z,use_quota=True,user_id='88dfc83a8a2642c1821329c674cdb32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae7f2eb-dcfb-4fdb-84c3-d365e45a892e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae7f2eb-dcfb-4fdb-84c3-d365e45a892e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0909ee1f-c7df-4253-87a2-fb6380c049a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0909ee1f-c7df-4253-87a2-fb6380c049a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f20c6c54-87f1-4ea1-9022-e5fefbe4eb43', 'volume_name': 'volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d77441c-2532-45ff-ae69-569c7a3c9edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d77441c-2532-45ff-ae69-569c7a3c9edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c2a75e0-07f3-4b83-bfe4-0c9bb23704a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:07 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Volume f20c6c54-87f1-4ea1-9022-e5fefbe4eb43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43', 'volume_size': 1} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-198943059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f20c6c54-87f1-4ea1-9022-e5fefbe4eb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3043b85614994b1a89a5114413ff6c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:08Z,use_quota=True,user_id='88dfc83a8a2642c1821329c674cdb32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Creating volume f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:07 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:17:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:07 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 1073741824 Sep 17 15:17:07 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:08 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 1073741824" returned: 0 in 0.467s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:08 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 Sep 17 15:17:08 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:08 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43" returned: 0 in 0.271s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c2a75e0-07f3-4b83-bfe4-0c9bb23704a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0315f770-7eec-4fc7-9267-f19e430794c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:08 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Volume volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 (f20c6c54-87f1-4ea1-9022-e5fefbe4eb43): created successfully Sep 17 15:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0315f770-7eec-4fc7-9267-f19e430794c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Flow 'volume_create_manager' (58b2cb92-52bc-46d2-81f2-f1fbfba4ce49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:08 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f33dfdc3-dfc3-4737-9741-6be357aa1b78 tempest-ProjectMemberTests-1513431654 None] Created volume successfully. Sep 17 15:17:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] Creating offline snapshot 9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a of volume f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:17:10 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f4f60d-a97f-42eb-80a2-978bafd6f855]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:10 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 Sep 17 15:17:10 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:10 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43" returned: 0 in 0.403s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:10 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a 1G Sep 17 15:17:10 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:10 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a 1G" returned: 0 in 0.507s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:11 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a Sep 17 15:17:11 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:11 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a" returned: 0 in 0.341s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:11 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a is being set with open permissions: ugo+rw Sep 17 15:17:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:11 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a Sep 17 15:17:11 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:11 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a" returned: 0 in 0.268s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:11 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.info Sep 17 15:17:11 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:11 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.info" returned: 0 in 0.355s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:11 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.info is being set with open permissions: ugo+rw Sep 17 15:17:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:12 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.info Sep 17 15:17:12 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:12 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.info" returned: 0 in 0.280s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.269s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:12 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-374e586d-11c5-4886-b6ec-c737a2164818 tempest-ProjectMemberTests-1513431654 None] Create snapshot completed successfully Sep 17 15:17:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] Lock "cinder-9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] Deleting offline snapshot 9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a of volume f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:17:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] snapshot_file for this snap is: volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:17:13 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cf59f7-3658-4651-b3a4-e83e56d94d0c]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:13 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a Sep 17 15:17:13 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:13 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a" returned: 0 in 0.399s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:17:13 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a842078b-57c2-4bbb-9554-3a4e5f719276]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:13 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 Sep 17 15:17:13 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:14 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43" returned: 0 in 0.396s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:14 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a Sep 17 15:17:14 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:14 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a" returned: 0 in 0.365s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:14 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a Sep 17 15:17:14 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:14 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43.9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a" returned: 0 in 0.348s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a" released by "_delete_snapshot" :: held 1.637s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43" released by "delete_snapshot" :: held 1.661s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:14 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] Created reservations ['919b87d2-2edc-4e21-9369-146372724e76', '39fe4d75-0034-4559-8870-c49e054efa78', '7daf8d1f-976d-4835-af39-0be47300dd1e', '00d8d6bf-6746-4090-a6a9-7a60b1786c25'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] Delete snapshot completed successfully. Sep 17 15:17:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-93eeba48-6c99-426b-bda8-08c6a721f53f tempest-ProjectMemberTests-1513431654 None] Lock "cinder-9ae20cee-dfc2-49ec-a585-ebc9d4cb7a7a-delete_snapshot" released by "delete_snapshot" :: held 1.819s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:15 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[060dfd51-d7fd-4252-93e3-d6a8e770adde]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:15 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 Sep 17 15:17:15 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:15 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43" returned: 0 in 0.456s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:16 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43 Sep 17 15:17:16 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Flow 'volume_create_manager' (a4bb299a-d892-4d79-a8cc-119febb96fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcedf058-14fa-419b-b116-52ce2d9c15ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcedf058-14fa-419b-b116-52ce2d9c15ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1620501007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca124317-2876-4b7a-a41a-6c199d3f8c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db9407d4dda4576842911eeaabc5cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:16Z,use_quota=True,user_id='d40f919212834034a403cb1a411e21b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbbe855f-7d38-4f81-833d-ce5fc02ffadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbbe855f-7d38-4f81-833d-ce5fc02ffadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7928565e-b102-4f8f-90eb-53f713e337f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7928565e-b102-4f8f-90eb-53f713e337f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca124317-2876-4b7a-a41a-6c199d3f8c17', 'volume_name': 'volume-ca124317-2876-4b7a-a41a-6c199d3f8c17', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff17a2f7-997f-40ed-aa65-b467ca911f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff17a2f7-997f-40ed-aa65-b467ca911f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e58b394-4ebe-4383-8117-ee51f7d0cbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:16 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Volume ca124317-2876-4b7a-a41a-6c199d3f8c17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca124317-2876-4b7a-a41a-6c199d3f8c17', 'volume_size': 1} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1620501007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca124317-2876-4b7a-a41a-6c199d3f8c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db9407d4dda4576842911eeaabc5cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:16Z,use_quota=True,user_id='d40f919212834034a403cb1a411e21b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Creating volume ca124317-2876-4b7a-a41a-6c199d3f8c17 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:16 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:16 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43" returned: 0 in 0.321s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:16 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 1073741824 Sep 17 15:17:16 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43" released by "delete_volume" :: held 0.847s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] Created reservations ['e2b13ced-d650-46eb-b0bc-bee994ec83aa', '54ed4adf-6bb8-4053-86e8-f553d585039f', 'ecaf4e1d-5170-4992-8947-de13abc9b254', 'cc3319de-e5cf-419a-9b4f-312555670b38'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:16 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:17:16 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:16 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.280s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:16 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] Deleted volume successfully. Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f8b1452c-d4ee-44a4-beb1-4c14b27ce187 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-f20c6c54-87f1-4ea1-9022-e5fefbe4eb43-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:16 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 1073741824" returned: 0 in 0.508s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:16 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 Sep 17 15:17:16 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Flow 'volume_create_manager' (3604d424-ddca-4dfa-83eb-72088cc371bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:17 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1660ff-d45c-4b4c-8481-58aaf38dfa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17" returned: 0 in 0.288s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1660ff-d45c-4b4c-8481-58aaf38dfa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-378730298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14b24cc-a69c-4add-bf53-f329bb4edb13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3043b85614994b1a89a5114413ff6c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:17Z,use_quota=True,user_id='88dfc83a8a2642c1821329c674cdb32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bd8f5b-d1e6-437e-b1b6-7644fe983d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11bd8f5b-d1e6-437e-b1b6-7644fe983d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6f303a-d5ba-4f75-ae5c-982e6a4ac2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6f303a-d5ba-4f75-ae5c-982e6a4ac2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14b24cc-a69c-4add-bf53-f329bb4edb13', 'volume_name': 'volume-f14b24cc-a69c-4add-bf53-f329bb4edb13', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b569e92-988d-4301-9ea9-14b7442549e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b569e92-988d-4301-9ea9-14b7442549e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff7956c-90d5-4ebb-bd96-11f59e7c4678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:17 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Volume f14b24cc-a69c-4add-bf53-f329bb4edb13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14b24cc-a69c-4add-bf53-f329bb4edb13', 'volume_size': 1} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-378730298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14b24cc-a69c-4add-bf53-f329bb4edb13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3043b85614994b1a89a5114413ff6c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:17Z,use_quota=True,user_id='88dfc83a8a2642c1821329c674cdb32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Creating volume f14b24cc-a69c-4add-bf53-f329bb4edb13 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:17 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e58b394-4ebe-4383-8117-ee51f7d0cbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca124317-2876-4b7a-a41a-6c199d3f8c17', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab8d43e-53e4-4a55-93c8-c5c1e300885b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:17 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13 1073741824 Sep 17 15:17:17 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:17 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Volume volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 (ca124317-2876-4b7a-a41a-6c199d3f8c17): created successfully Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab8d43e-53e4-4a55-93c8-c5c1e300885b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Flow 'volume_create_manager' (a4bb299a-d892-4d79-a8cc-119febb96fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:17 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b61eff76-0235-4fe1-91e8-ef24c5301437 tempest-SnapshotDependencyTests-1901209896 None] Created volume successfully. Sep 17 15:17:17 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13 1073741824" returned: 0 in 0.468s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:17 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13 Sep 17 15:17:17 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:17 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13" returned: 0 in 0.253s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff7956c-90d5-4ebb-bd96-11f59e7c4678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14b24cc-a69c-4add-bf53-f329bb4edb13', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5295391-fbb1-4069-aa0f-fe067aa0b860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:17 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Volume volume-f14b24cc-a69c-4add-bf53-f329bb4edb13 (f14b24cc-a69c-4add-bf53-f329bb4edb13): created successfully Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5295391-fbb1-4069-aa0f-fe067aa0b860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Flow 'volume_create_manager' (3604d424-ddca-4dfa-83eb-72088cc371bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:17 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-66707cef-ec3d-46b4-bee4-3c2e252d8dad tempest-ProjectMemberTests-1513431654 None] Created volume successfully. Sep 17 15:17:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] Creating offline snapshot 17be1924-3bfe-47ca-a1e3-fa37059f7301 of volume f14b24cc-a69c-4add-bf53-f329bb4edb13 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:17:18 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[062b9b36-b436-4093-9cf1-0da2c3c8933b]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:18 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13 Sep 17 15:17:18 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:18 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13" returned: 0 in 0.401s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:18 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301 1G Sep 17 15:17:18 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:19 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301 1G" returned: 0 in 0.391s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f14b24cc-a69c-4add-bf53-f329bb4edb13 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:19 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f14b24cc-a69c-4add-bf53-f329bb4edb13 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301 Sep 17 15:17:19 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:19 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f14b24cc-a69c-4add-bf53-f329bb4edb13 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301" returned: 0 in 0.298s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:19 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301 is being set with open permissions: ugo+rw Sep 17 15:17:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:19 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301 Sep 17 15:17:19 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:19 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301" returned: 0 in 0.261s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:19 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.info Sep 17 15:17:19 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:19 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.info" returned: 0 in 0.251s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:19 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.info is being set with open permissions: ugo+rw Sep 17 15:17:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:19 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.info Sep 17 15:17:19 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:20 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.info" returned: 0 in 0.235s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.919s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.666s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] Creating offline snapshot b2fb2358-8c8c-44fd-8048-1e93f64a5507 of volume ca124317-2876-4b7a-a41a-6c199d3f8c17 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:17:20 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9b7820f1-2bae-4d0d-ba62-52a27ba233f5 tempest-ProjectMemberTests-1513431654 None] Create snapshot completed successfully Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b48ba31-fa35-4451-8e3e-c5e1eb2dbdf0]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:20 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 Sep 17 15:17:20 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-17be1924-3bfe-47ca-a1e3-fa37059f7301-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] Lock "cinder-17be1924-3bfe-47ca-a1e3-fa37059f7301-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-f14b24cc-a69c-4add-bf53-f329bb4edb13" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-f14b24cc-a69c-4add-bf53-f329bb4edb13" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-17be1924-3bfe-47ca-a1e3-fa37059f7301" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-17be1924-3bfe-47ca-a1e3-fa37059f7301" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] Deleting offline snapshot 17be1924-3bfe-47ca-a1e3-fa37059f7301 of volume f14b24cc-a69c-4add-bf53-f329bb4edb13 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] snapshot_file for this snap is: volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1f5e3c-aa55-4f11-8fff-40e75d42fc8e]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:20 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301 Sep 17 15:17:20 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:20 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17" returned: 0 in 0.432s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:20 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507 1G Sep 17 15:17:20 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:20 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301" returned: 0 in 0.398s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f14b24cc-a69c-4add-bf53-f329bb4edb13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e82b7a-2cbd-4a9e-8890-f3200c0db2dd]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:21 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:21 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13 Sep 17 15:17:21 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507 1G" returned: 0 in 0.431s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:21 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507 Sep 17 15:17:21 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:21 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13" returned: 0 in 0.405s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:21 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:21 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301 Sep 17 15:17:21 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507" returned: 0 in 0.309s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:21 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507 is being set with open permissions: ugo+rw Sep 17 15:17:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:21 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507 Sep 17 15:17:21 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:21 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507" returned: 0 in 0.287s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:21 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301" returned: 0 in 0.370s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:21 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.info Sep 17 15:17:21 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:21 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301 Sep 17 15:17:21 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:21 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.info" returned: 0 in 0.270s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:21 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.info is being set with open permissions: ugo+rw Sep 17 15:17:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:21 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13.17be1924-3bfe-47ca-a1e3-fa37059f7301" returned: 0 in 0.274s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:21 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.info Sep 17 15:17:21 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-17be1924-3bfe-47ca-a1e3-fa37059f7301" released by "_delete_snapshot" :: held 1.562s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-f14b24cc-a69c-4add-bf53-f329bb4edb13" released by "delete_snapshot" :: held 1.592s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:22 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] Created reservations ['ef42aee2-8a1a-4959-be7b-e32451852a77', '0e242810-3a01-4e78-b403-7e9bfb383d36', 'c94f493e-1c1b-4c52-ac14-6510b779c6bb', 'd9268eb4-bbba-4171-9c65-a267a1aae546'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] Delete snapshot completed successfully. Sep 17 15:17:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e4086369-3e20-45bf-8934-f77afa62b5ed tempest-ProjectMemberTests-1513431654 None] Lock "cinder-17be1924-3bfe-47ca-a1e3-fa37059f7301-delete_snapshot" released by "delete_snapshot" :: held 1.728s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:22 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.info" returned: 0 in 0.260s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.090s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d41df0bd-9daf-43b0-9b1e-fc83a6ca3743 tempest-SnapshotDependencyTests-1901209896 None] Create snapshot completed successfully Sep 17 15:17:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-f14b24cc-a69c-4add-bf53-f329bb4edb13-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-f14b24cc-a69c-4add-bf53-f329bb4edb13-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-f14b24cc-a69c-4add-bf53-f329bb4edb13" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-f14b24cc-a69c-4add-bf53-f329bb4edb13" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:22 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5d5d64-c999-4b58-af45-3cab9cd38684]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:22 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13 Sep 17 15:17:22 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:23 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13" returned: 0 in 0.397s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:23 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13 Sep 17 15:17:23 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Flow 'volume_create_manager' (dc5383c5-6b11-4db7-982a-803caa8024a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91929a07-b1ff-4657-9cd0-7a76f59c6e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:23 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-f14b24cc-a69c-4add-bf53-f329bb4edb13" returned: 0 in 0.279s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91929a07-b1ff-4657-9cd0-7a76f59c6e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b8d2f6-6e22-4111-bda5-dacfa40a7173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db9407d4dda4576842911eeaabc5cf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b2fb2358-8c8c-44fd-8048-1e93f64a5507,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:23Z,use_quota=True,user_id='d40f919212834034a403cb1a411e21b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81ec164-347c-46bf-a9db-4fe0f6b0e7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81ec164-347c-46bf-a9db-4fe0f6b0e7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1303e232-5348-4d47-99f9-5905093db573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1303e232-5348-4d47-99f9-5905093db573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '46b8d2f6-6e22-4111-bda5-dacfa40a7173', 'volume_name': 'volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173', 'volume_size': 1, 'snapshot_id': 'b2fb2358-8c8c-44fd-8048-1e93f64a5507'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c6e415-a293-415f-b0c6-f5c8182cfa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c6e415-a293-415f-b0c6-f5c8182cfa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fedce33-faf9-46f8-b399-86c02cfaca38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:23 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Volume 46b8d2f6-6e22-4111-bda5-dacfa40a7173: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173', 'volume_size': 1, 'snapshot_id': 'b2fb2358-8c8c-44fd-8048-1e93f64a5507'} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-f14b24cc-a69c-4add-bf53-f329bb4edb13" released by "delete_volume" :: held 0.791s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Acquiring lock "cinder-quobyte-b2fb2358-8c8c-44fd-8048-1e93f64a5507-46b8d2f6-6e22-4111-bda5-dacfa40a7173" by "_create_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Lock "cinder-quobyte-b2fb2358-8c8c-44fd-8048-1e93f64a5507-46b8d2f6-6e22-4111-bda5-dacfa40a7173" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Creating volume 46b8d2f6-6e22-4111-bda5-dacfa40a7173 from snapshot b2fb2358-8c8c-44fd-8048-1e93f64a5507 {{(pid=86082) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Acquiring lock "cinder-quobyte-46b8d2f6-6e22-4111-bda5-dacfa40a7173" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Lock "cinder-quobyte-46b8d2f6-6e22-4111-bda5-dacfa40a7173" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] snapshot: b2fb2358-8c8c-44fd-8048-1e93f64a5507, volume: 46b8d2f6-6e22-4111-bda5-dacfa40a7173, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] Created reservations ['3fb6b35a-862a-480b-a67c-9f3c57cd5906', 'eca00baf-4e7e-47ee-9324-e778e75f5865', '714317a0-f7b0-42e2-8073-1386de080911', '583e7dad-e0b5-410b-930b-2191f43167bf'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f670a5e-c34f-49ce-b9c0-784e0cabb8cc]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:23 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:17:23 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:23 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507 Sep 17 15:17:23 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:23 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.274s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] Deleted volume successfully. Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3431fb6f-eff2-4b1c-ba46-850ec8524fd8 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-f14b24cc-a69c-4add-bf53-f329bb4edb13-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:23 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507" returned: 0 in 0.428s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca124317-2876-4b7a-a41a-6c199d3f8c17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23cfe6c-ff86-4856-bd8c-b15f06afa484]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:24 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 Sep 17 15:17:24 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:24 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Flow 'volume_create_manager' (74dfff37-26fd-4b07-9b2c-7ed35fb93e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37313f3-9596-4fe8-adf5-55805cfc118c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37313f3-9596-4fe8-adf5-55805cfc118c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879711793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724b102c-b7d7-43d8-ace9-1cc95a542381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3043b85614994b1a89a5114413ff6c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:24Z,use_quota=True,user_id='88dfc83a8a2642c1821329c674cdb32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a723200a-8361-4fb4-8952-f7ddd2483105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a723200a-8361-4fb4-8952-f7ddd2483105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ae51f1-8808-4662-8cc9-7b8ae4431e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ae51f1-8808-4662-8cc9-7b8ae4431e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '724b102c-b7d7-43d8-ace9-1cc95a542381', 'volume_name': 'volume-724b102c-b7d7-43d8-ace9-1cc95a542381', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb166075-9cf1-4743-9cbc-b301c03b065e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb166075-9cf1-4743-9cbc-b301c03b065e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0297833b-a4fe-498a-a345-457b7ae9acaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:24 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Volume 724b102c-b7d7-43d8-ace9-1cc95a542381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-724b102c-b7d7-43d8-ace9-1cc95a542381', 'volume_size': 1} Sep 17 15:17:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:24 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17" returned: 0 in 0.397s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:17:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:17:24 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Path /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173 not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:17:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:24 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173 Sep 17 15:17:24 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:30 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173" returned: 0 in 5.945s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Image conversion details: src /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 17 15:17:30 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Converted 1024.00 MB image at 172.21 MB/s Sep 17 15:17:30 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173 is being set with open permissions: ugo+rw Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:30 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173 Sep 17 15:17:30 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:30 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173" returned: 0 in 0.249s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Lock "cinder-quobyte-46b8d2f6-6e22-4111-bda5-dacfa40a7173" released by "_copy_volume_from_snapshot" :: held 7.110s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=150,cinder:UPDATE=174,cinder:DELETE=17,cinder:INSERT=45 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=150,cinder:INSERT=58,cinder:UPDATE=205,cinder:DELETE=14 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Lock "cinder-quobyte-b2fb2358-8c8c-44fd-8048-1e93f64a5507-46b8d2f6-6e22-4111-bda5-dacfa40a7173" released by "_create_volume_from_snapshot" :: held 7.185s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.203s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.346s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-879711793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724b102c-b7d7-43d8-ace9-1cc95a542381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3043b85614994b1a89a5114413ff6c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:24Z,use_quota=True,user_id='88dfc83a8a2642c1821329c674cdb32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Creating volume 724b102c-b7d7-43d8-ace9-1cc95a542381 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:30 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:30 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381 1073741824 Sep 17 15:17:30 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fedce33-faf9-46f8-b399-86c02cfaca38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173', 'volume_size': 1, 'snapshot_id': 'b2fb2358-8c8c-44fd-8048-1e93f64a5507'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e4ebc8-ef7d-4a44-b866-20c7cae89ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:30 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Volume volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173 (46b8d2f6-6e22-4111-bda5-dacfa40a7173): created successfully Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e4ebc8-ef7d-4a44-b866-20c7cae89ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Flow 'volume_create_manager' (dc5383c5-6b11-4db7-982a-803caa8024a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:30 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fa573b1c-687c-4e7a-a0a8-3ed6897d97ae tempest-SnapshotDependencyTests-1901209896 None] Created volume successfully. Sep 17 15:17:31 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381 1073741824" returned: 0 in 0.420s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:31 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381 Sep 17 15:17:31 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:31 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381" returned: 0 in 0.245s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0297833b-a4fe-498a-a345-457b7ae9acaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-724b102c-b7d7-43d8-ace9-1cc95a542381', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7181fb7-ad11-4dcf-83a5-5f8b3f36af2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:31 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Volume volume-724b102c-b7d7-43d8-ace9-1cc95a542381 (724b102c-b7d7-43d8-ace9-1cc95a542381): created successfully Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7181fb7-ad11-4dcf-83a5-5f8b3f36af2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Flow 'volume_create_manager' (74dfff37-26fd-4b07-9b2c-7ed35fb93e76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-142ace10-f280-4bb7-9512-25a017299e05 tempest-ProjectMemberTests-1513431654 None] Created volume successfully. Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] Acquiring lock "cinder-b2fb2358-8c8c-44fd-8048-1e93f64a5507-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] Lock "cinder-b2fb2358-8c8c-44fd-8048-1e93f64a5507-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] Acquiring lock "cinder-quobyte-ca124317-2876-4b7a-a41a-6c199d3f8c17" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] Creating offline snapshot af0431bc-115f-4926-a998-17e380779dd5 of volume 724b102c-b7d7-43d8-ace9-1cc95a542381 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] Lock "cinder-quobyte-ca124317-2876-4b7a-a41a-6c199d3f8c17" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] Acquiring lock "cinder-quobyte-b2fb2358-8c8c-44fd-8048-1e93f64a5507" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] Lock "cinder-quobyte-b2fb2358-8c8c-44fd-8048-1e93f64a5507" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] Deleting offline snapshot b2fb2358-8c8c-44fd-8048-1e93f64a5507 of volume ca124317-2876-4b7a-a41a-6c199d3f8c17 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] snapshot_file for this snap is: volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dad627-2ff3-401a-8dcf-32cf04fdaa50]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6530cb-db88-4fbc-973a-b61d13381ad1]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:32 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381 Sep 17 15:17:32 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:32 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507 Sep 17 15:17:32 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:32 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381" returned: 0 in 0.375s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:32 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507" returned: 0 in 0.376s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca124317-2876-4b7a-a41a-6c199d3f8c17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:17:32 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5 1G Sep 17 15:17:32 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:32 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0139fbfa-f905-41e5-a9cf-849023bba824]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:32 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 Sep 17 15:17:32 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:32 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5 1G" returned: 0 in 0.425s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-724b102c-b7d7-43d8-ace9-1cc95a542381 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:32 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-724b102c-b7d7-43d8-ace9-1cc95a542381 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5 Sep 17 15:17:32 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:32 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17" returned: 0 in 0.583s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:32 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507 Sep 17 15:17:32 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:33 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-724b102c-b7d7-43d8-ace9-1cc95a542381 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5" returned: 0 in 0.305s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:33 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5 is being set with open permissions: ugo+rw Sep 17 15:17:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:33 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5 Sep 17 15:17:33 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:33 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507" returned: 0 in 0.327s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:33 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507 Sep 17 15:17:33 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:33 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5" returned: 0 in 0.260s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:33 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.info Sep 17 15:17:33 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:33 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17.b2fb2358-8c8c-44fd-8048-1e93f64a5507" returned: 0 in 0.242s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] Lock "cinder-quobyte-b2fb2358-8c8c-44fd-8048-1e93f64a5507" released by "_delete_snapshot" :: held 1.643s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] Lock "cinder-quobyte-ca124317-2876-4b7a-a41a-6c199d3f8c17" released by "delete_snapshot" :: held 1.667s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:33 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.info" returned: 0 in 0.272s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:33 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.info is being set with open permissions: ugo+rw Sep 17 15:17:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:33 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.info Sep 17 15:17:33 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:33 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] Created reservations ['fe85cd0f-6b49-4b6a-add0-a40204078513', '5a7f608c-b25b-45b1-a858-3a24dfa56f56', 'd9068a7c-6a66-4067-aa3a-d1da386b10a8', '9c0ad53e-7ca3-4120-b7c2-58e9aa43fa3d'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] Delete snapshot completed successfully. Sep 17 15:17:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d4e2fec9-01bb-47c0-9f04-1788f2eff9d8 tempest-SnapshotDependencyTests-1901209896 None] Lock "cinder-b2fb2358-8c8c-44fd-8048-1e93f64a5507-delete_snapshot" released by "delete_snapshot" :: held 1.833s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:33 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.info" returned: 0 in 0.252s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e2bf5a48-84ea-4e96-9e78-387d4b34aa53 tempest-ProjectMemberTests-1513431654 None] Create snapshot completed successfully Sep 17 15:17:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] Acquiring lock "cinder-ca124317-2876-4b7a-a41a-6c199d3f8c17-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] Lock "cinder-ca124317-2876-4b7a-a41a-6c199d3f8c17-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] Acquiring lock "cinder-quobyte-ca124317-2876-4b7a-a41a-6c199d3f8c17" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] Lock "cinder-quobyte-ca124317-2876-4b7a-a41a-6c199d3f8c17" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:34 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7035b05-6a9d-47a1-ba98-bedeb0aa0608]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:34 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 Sep 17 15:17:34 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:34 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17" returned: 0 in 0.379s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:34 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17 Sep 17 15:17:34 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:34 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ca124317-2876-4b7a-a41a-6c199d3f8c17" returned: 0 in 0.252s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] Lock "cinder-quobyte-ca124317-2876-4b7a-a41a-6c199d3f8c17" released by "delete_volume" :: held 0.689s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:34 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] Created reservations ['fd9ae155-9d56-4a9a-8fff-6b123b0a1e6d', '84e03487-959b-4176-bc27-9bc9e348c424', '6f14adbf-6eaa-42fb-8c28-18d6cfaef118', 'f869d07e-92ec-4b61-915b-574c03e8c461'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:34 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:17:34 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-af0431bc-115f-4926-a998-17e380779dd5-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-af0431bc-115f-4926-a998-17e380779dd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-724b102c-b7d7-43d8-ace9-1cc95a542381" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-724b102c-b7d7-43d8-ace9-1cc95a542381" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-af0431bc-115f-4926-a998-17e380779dd5" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-af0431bc-115f-4926-a998-17e380779dd5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] Deleting offline snapshot af0431bc-115f-4926-a998-17e380779dd5 of volume 724b102c-b7d7-43d8-ace9-1cc95a542381 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] snapshot_file for this snap is: volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:17:35 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.253s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:35 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] Deleted volume successfully. Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4951c871-7a8d-40c3-a7d0-9b5133901650]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] Acquiring lock "cinder-46b8d2f6-6e22-4111-bda5-dacfa40a7173-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3a84dd83-306a-4af6-8d82-2cfba73b2d54 tempest-SnapshotDependencyTests-1901209896 None] Lock "cinder-ca124317-2876-4b7a-a41a-6c199d3f8c17-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] Lock "cinder-46b8d2f6-6e22-4111-bda5-dacfa40a7173-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] Acquiring lock "cinder-quobyte-46b8d2f6-6e22-4111-bda5-dacfa40a7173" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] Lock "cinder-quobyte-46b8d2f6-6e22-4111-bda5-dacfa40a7173" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:35 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5 Sep 17 15:17:35 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c6de3f-d72b-4dea-a0d5-0f98f3183fc1]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:35 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173 Sep 17 15:17:35 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:35 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5" returned: 0 in 0.388s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-724b102c-b7d7-43d8-ace9-1cc95a542381(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05c4cd5-16b2-4a96-b3ec-4ea1ddce4dd3]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:35 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173" returned: 0 in 0.415s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:35 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381 Sep 17 15:17:35 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:35 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173 Sep 17 15:17:35 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:35 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-46b8d2f6-6e22-4111-bda5-dacfa40a7173" returned: 0 in 0.259s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] Lock "cinder-quobyte-46b8d2f6-6e22-4111-bda5-dacfa40a7173" released by "delete_volume" :: held 0.724s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:35 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381" returned: 0 in 0.413s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:36 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5 Sep 17 15:17:36 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:36 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] Created reservations ['a99a5d96-46aa-4408-a014-07dc5610744e', 'd37040f4-06c0-4efd-b247-582477d9a1a7', '74b2841f-a26f-4f80-893c-2874fc17696f', 'c0613733-3f39-4841-8a2e-7956053863de'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:36 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:17:36 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:36 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5" returned: 0 in 0.398s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:36 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5 Sep 17 15:17:36 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:36 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.296s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:36 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:36 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] Deleted volume successfully. Sep 17 15:17:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-60fa2efc-d8be-4572-911c-e3db8dea7922 tempest-SnapshotDependencyTests-1901209896 None] Lock "cinder-46b8d2f6-6e22-4111-bda5-dacfa40a7173-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:36 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381.af0431bc-115f-4926-a998-17e380779dd5" returned: 0 in 0.251s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-af0431bc-115f-4926-a998-17e380779dd5" released by "_delete_snapshot" :: held 1.590s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-724b102c-b7d7-43d8-ace9-1cc95a542381" released by "delete_snapshot" :: held 1.620s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:36 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] Created reservations ['7b45e22b-1686-4dce-b97f-87bb42900489', '6b37cde6-8439-465f-8428-ae2e8c99635d', '93dabd41-3b73-4a03-9687-98c6d54e0754', '8e121b3b-17d6-4096-a37e-141f810954d0'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:36 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] Delete snapshot completed successfully. Sep 17 15:17:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2ee668eb-33ea-41ce-955c-1a10dc623b13 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-af0431bc-115f-4926-a998-17e380779dd5-delete_snapshot" released by "delete_snapshot" :: held 1.763s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-724b102c-b7d7-43d8-ace9-1cc95a542381-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-724b102c-b7d7-43d8-ace9-1cc95a542381-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-724b102c-b7d7-43d8-ace9-1cc95a542381" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-724b102c-b7d7-43d8-ace9-1cc95a542381" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:37 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2748dd3c-bfd7-4552-97d2-cb42286e6ebd]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:37 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381 Sep 17 15:17:37 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:37 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381" returned: 0 in 0.377s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:37 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381 Sep 17 15:17:37 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:37 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-724b102c-b7d7-43d8-ace9-1cc95a542381" returned: 0 in 0.270s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-724b102c-b7d7-43d8-ace9-1cc95a542381" released by "delete_volume" :: held 0.718s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] Created reservations ['fb296a4c-11cb-4252-a08d-d4edebf5f0e0', 'b3ceb234-c74e-4e58-bc78-5737cadc59e6', 'ea7c47d7-23d9-4f81-9f04-8f59784674d8', 'e98fcfb0-9d50-4f4c-a9d0-99ef229e40c4'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:38 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:17:38 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:38 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:38 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] Deleted volume successfully. Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-999fab19-ff0d-46ab-b601-4e375ba4f788 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-724b102c-b7d7-43d8-ace9-1cc95a542381-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Flow 'volume_create_manager' (bbc4bb39-738f-48c5-aca2-cf460f773588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a34804c2-b2a7-444f-b87b-e95cba173ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a34804c2-b2a7-444f-b87b-e95cba173ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-348967817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3bcd86-bad4-465b-b852-75e3ca70fb06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3043b85614994b1a89a5114413ff6c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:39Z,use_quota=True,user_id='88dfc83a8a2642c1821329c674cdb32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d72bd7-45d3-4925-ae39-11bae8f632f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d72bd7-45d3-4925-ae39-11bae8f632f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0635daee-db00-4472-9a9e-446364485ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0635daee-db00-4472-9a9e-446364485ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad3bcd86-bad4-465b-b852-75e3ca70fb06', 'volume_name': 'volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec29a30e-ec57-40c2-a9d1-a9b79c34fc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec29a30e-ec57-40c2-a9d1-a9b79c34fc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c26e7fa-fdb7-43b5-bc9c-5f7dd7c8466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:38 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Volume ad3bcd86-bad4-465b-b852-75e3ca70fb06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06', 'volume_size': 1} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-348967817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad3bcd86-bad4-465b-b852-75e3ca70fb06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3043b85614994b1a89a5114413ff6c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:39Z,use_quota=True,user_id='88dfc83a8a2642c1821329c674cdb32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Creating volume ad3bcd86-bad4-465b-b852-75e3ca70fb06 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:38 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:17:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:39 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06 1073741824 Sep 17 15:17:39 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:39 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06 1073741824" returned: 0 in 0.403s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:39 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06 Sep 17 15:17:39 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:39 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c26e7fa-fdb7-43b5-bc9c-5f7dd7c8466a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2ff1e1-81ee-4a99-bc25-5608aec61992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:39 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Volume volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06 (ad3bcd86-bad4-465b-b852-75e3ca70fb06): created successfully Sep 17 15:17:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2ff1e1-81ee-4a99-bc25-5608aec61992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Flow 'volume_create_manager' (bbc4bb39-738f-48c5-aca2-cf460f773588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:39 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9e87f6e9-f15a-4dc2-a6a9-b5c7693dee4f tempest-ProjectMemberTests-1513431654 None] Created volume successfully. Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] Creating offline snapshot 284680f3-99eb-46cd-97c0-5b8b0adbcbe8 of volume ad3bcd86-bad4-465b-b852-75e3ca70fb06 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d3dd50-962e-4ec0-b86e-12aa6230116e]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:40 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06 Sep 17 15:17:40 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:40 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:17:40 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:40 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06" returned: 0 in 0.392s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:40 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8 1G Sep 17 15:17:40 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:40 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.277s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:17:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] thread info: [<_MainThread(MainThread, started 139116419633280)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:17:41 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8 1G" returned: 0 in 0.495s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:41 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8 Sep 17 15:17:41 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:41 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8" returned: 0 in 0.290s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:41 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8 is being set with open permissions: ugo+rw Sep 17 15:17:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:41 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8 Sep 17 15:17:41 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:41 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8" returned: 0 in 0.247s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:41 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.info Sep 17 15:17:41 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:41 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.info" returned: 0 in 0.275s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:41 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.info is being set with open permissions: ugo+rw Sep 17 15:17:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:41 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.info Sep 17 15:17:41 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:42 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.info" returned: 0 in 0.239s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.050s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:42 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2cb29fa7-ab37-4688-be98-b2d3bdfea2af tempest-ProjectMemberTests-1513431654 None] Create snapshot completed successfully Sep 17 15:17:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-284680f3-99eb-46cd-97c0-5b8b0adbcbe8-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-284680f3-99eb-46cd-97c0-5b8b0adbcbe8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-ad3bcd86-bad4-465b-b852-75e3ca70fb06" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-ad3bcd86-bad4-465b-b852-75e3ca70fb06" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-284680f3-99eb-46cd-97c0-5b8b0adbcbe8" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-284680f3-99eb-46cd-97c0-5b8b0adbcbe8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] Deleting offline snapshot 284680f3-99eb-46cd-97c0-5b8b0adbcbe8 of volume ad3bcd86-bad4-465b-b852-75e3ca70fb06 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:17:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] snapshot_file for this snap is: volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:17:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8ee26d-8fca-4caa-b819-8c0e4cc34e7a]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:43 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8 Sep 17 15:17:43 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:43 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8" returned: 0 in 0.361s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:17:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a13afd-c174-4543-91d3-9c3aa6ad8378]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:43 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06 Sep 17 15:17:43 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:44 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06" returned: 0 in 0.386s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:44 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8 Sep 17 15:17:44 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:44 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8" returned: 0 in 0.385s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:44 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8 Sep 17 15:17:44 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:44 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06.284680f3-99eb-46cd-97c0-5b8b0adbcbe8" returned: 0 in 0.270s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-284680f3-99eb-46cd-97c0-5b8b0adbcbe8" released by "_delete_snapshot" :: held 1.506s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-ad3bcd86-bad4-465b-b852-75e3ca70fb06" released by "delete_snapshot" :: held 1.529s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:44 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] Created reservations ['4813c8d2-3e8d-4933-bff3-115bf52a517a', 'ce630e12-0069-4c6b-b618-7cf04a1eb446', 'fd405a3a-ae13-485a-bc8b-b81c366046de', '10acd6dd-549c-467f-8353-d099a7e1cacf'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] Delete snapshot completed successfully. Sep 17 15:17:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6959741e-5b4f-4139-a1d2-4780c3895c48 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-284680f3-99eb-46cd-97c0-5b8b0adbcbe8-delete_snapshot" released by "delete_snapshot" :: held 1.700s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-ad3bcd86-bad4-465b-b852-75e3ca70fb06-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-ad3bcd86-bad4-465b-b852-75e3ca70fb06-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-ad3bcd86-bad4-465b-b852-75e3ca70fb06" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-ad3bcd86-bad4-465b-b852-75e3ca70fb06" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:45 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[41102b44-b097-45a6-82c3-088373d090c3]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:45 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06 Sep 17 15:17:45 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:46 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06" returned: 0 in 0.386s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:46 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06 Sep 17 15:17:46 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:46 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-ad3bcd86-bad4-465b-b852-75e3ca70fb06" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-ad3bcd86-bad4-465b-b852-75e3ca70fb06" released by "delete_volume" :: held 0.729s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:46 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] Created reservations ['5b1dc0b9-bb1e-4122-8cad-218df0ec0cc2', '5b8dc8be-d345-4660-ab14-e9e54c226e28', 'd82352d9-6592-4edc-b773-6bd6dfb88d4d', 'f77a21f8-c8e1-4177-b232-28e5b2a86f93'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:46 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:17:46 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:46 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.305s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:46 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] Deleted volume successfully. Sep 17 15:17:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-edd75d94-c1e7-4ab1-9acc-e2a1c1880d12 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-ad3bcd86-bad4-465b-b852-75e3ca70fb06-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Flow 'volume_create_manager' (d2f91251-14dd-4379-b3b2-f64d09e10d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01bdf564-cec7-4140-bcf2-b40d4720795a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01bdf564-cec7-4140-bcf2-b40d4720795a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511625086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18e3807-bab9-4311-8110-fb40f962b496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3043b85614994b1a89a5114413ff6c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:47Z,use_quota=True,user_id='88dfc83a8a2642c1821329c674cdb32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e2bca4-a8ec-4f8e-86c5-7ac21c52f8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e2bca4-a8ec-4f8e-86c5-7ac21c52f8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac7b191-950c-4597-ae95-cc0e02068c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac7b191-950c-4597-ae95-cc0e02068c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18e3807-bab9-4311-8110-fb40f962b496', 'volume_name': 'volume-b18e3807-bab9-4311-8110-fb40f962b496', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7735312d-1b23-4711-8721-8bc6a8d93ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7735312d-1b23-4711-8721-8bc6a8d93ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1c5b54-c68e-4ddb-af2d-3e134d293aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:47 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Volume b18e3807-bab9-4311-8110-fb40f962b496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18e3807-bab9-4311-8110-fb40f962b496', 'volume_size': 1} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511625086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18e3807-bab9-4311-8110-fb40f962b496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3043b85614994b1a89a5114413ff6c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:47Z,use_quota=True,user_id='88dfc83a8a2642c1821329c674cdb32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Creating volume b18e3807-bab9-4311-8110-fb40f962b496 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:47 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:47 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496 1073741824 Sep 17 15:17:47 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:47 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496 1073741824" returned: 0 in 0.424s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:47 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496 Sep 17 15:17:47 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:47 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c1c5b54-c68e-4ddb-af2d-3e134d293aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18e3807-bab9-4311-8110-fb40f962b496', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efff7f92-a7d1-40a0-ae26-82faf6665936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:47 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Volume volume-b18e3807-bab9-4311-8110-fb40f962b496 (b18e3807-bab9-4311-8110-fb40f962b496): created successfully Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efff7f92-a7d1-40a0-ae26-82faf6665936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Flow 'volume_create_manager' (d2f91251-14dd-4379-b3b2-f64d09e10d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:47 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2a6f3b30-a98f-401e-bdd3-e1d55b68a9b8 tempest-ProjectMemberTests-1513431654 None] Created volume successfully. Sep 17 15:17:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] Creating offline snapshot 67834763-cea5-4be3-a099-b78b0252ebb7 of volume b18e3807-bab9-4311-8110-fb40f962b496 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:17:48 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8057234-3429-4fe2-8869-e937adc5bfac]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:48 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496 Sep 17 15:17:48 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:48 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496" returned: 0 in 0.352s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:48 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7 1G Sep 17 15:17:48 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:49 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7 1G" returned: 0 in 0.381s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b18e3807-bab9-4311-8110-fb40f962b496 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:49 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b18e3807-bab9-4311-8110-fb40f962b496 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7 Sep 17 15:17:49 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:49 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b18e3807-bab9-4311-8110-fb40f962b496 -F qcow2 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7" returned: 0 in 0.286s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:49 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7 is being set with open permissions: ugo+rw Sep 17 15:17:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:49 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7 Sep 17 15:17:49 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:49 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7" returned: 0 in 0.253s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:49 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.info Sep 17 15:17:49 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:49 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.info" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:49 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.info is being set with open permissions: ugo+rw Sep 17 15:17:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:49 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.info Sep 17 15:17:49 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:50 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.info" returned: 0 in 0.240s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.838s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8a9e6d7a-69ba-40f2-a5b6-a1f8481895d7 tempest-ProjectMemberTests-1513431654 None] Create snapshot completed successfully Sep 17 15:17:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-67834763-cea5-4be3-a099-b78b0252ebb7-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] Lock "cinder-67834763-cea5-4be3-a099-b78b0252ebb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-b18e3807-bab9-4311-8110-fb40f962b496" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-b18e3807-bab9-4311-8110-fb40f962b496" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-67834763-cea5-4be3-a099-b78b0252ebb7" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-67834763-cea5-4be3-a099-b78b0252ebb7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] Deleting offline snapshot 67834763-cea5-4be3-a099-b78b0252ebb7 of volume b18e3807-bab9-4311-8110-fb40f962b496 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:17:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] snapshot_file for this snap is: volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:17:50 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d07f67-36a4-4e94-bb88-1dad596da133]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:50 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7 Sep 17 15:17:50 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:50 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7" returned: 0 in 0.347s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b18e3807-bab9-4311-8110-fb40f962b496(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:17:50 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[adca20e6-d78a-495d-aed2-22dabb7860ac]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:51 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496 Sep 17 15:17:51 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:51 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496" returned: 0 in 0.338s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:51 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7 Sep 17 15:17:51 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:51 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7" returned: 0 in 0.326s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:51 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7 Sep 17 15:17:51 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:51 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496.67834763-cea5-4be3-a099-b78b0252ebb7" returned: 0 in 0.232s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-67834763-cea5-4be3-a099-b78b0252ebb7" released by "_delete_snapshot" :: held 1.338s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-b18e3807-bab9-4311-8110-fb40f962b496" released by "delete_snapshot" :: held 1.360s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:51 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] Created reservations ['3e0bb44e-7c24-4d5a-bd98-c65f7f42640a', '21d0eb47-fc7e-4d56-b991-9f3d46158c96', '4b12843f-fc41-4510-9dc5-c6c5d1037b60', 'f4bd33e2-efb6-4d94-aa23-77beb321640a'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] Delete snapshot completed successfully. Sep 17 15:17:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-05606fa7-4127-4c30-af21-0d875016f21e tempest-ProjectMemberTests-1513431654 None] Lock "cinder-67834763-cea5-4be3-a099-b78b0252ebb7-delete_snapshot" released by "delete_snapshot" :: held 1.480s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-b18e3807-bab9-4311-8110-fb40f962b496-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-b18e3807-bab9-4311-8110-fb40f962b496-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "cinder-quobyte-b18e3807-bab9-4311-8110-fb40f962b496" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-b18e3807-bab9-4311-8110-fb40f962b496" acquired by "delete_volume" :: waited 0.012s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:52 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba560454-b5b2-4943-b9f5-760901160fff]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:52 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496 Sep 17 15:17:52 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:53 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496" returned: 0 in 0.351s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:53 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496 Sep 17 15:17:53 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:53 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-b18e3807-bab9-4311-8110-fb40f962b496" returned: 0 in 0.235s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-quobyte-b18e3807-bab9-4311-8110-fb40f962b496" released by "delete_volume" :: held 0.641s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:53 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] Created reservations ['7525ff40-c53d-46bf-a83a-703eafa6855e', '88694c7d-4187-4d23-bd69-aae1679fba27', 'bf6b72ff-4fe7-40a3-a509-91c912daf31a', 'b550d816-5241-47a1-a832-8467f49c851c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:53 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:17:53 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:53 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.236s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:53 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] Deleted volume successfully. Sep 17 15:17:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d9aa86c1-70c6-4b52-bd32-8dab85bd72b8 tempest-ProjectMemberTests-1513431654 None] Lock "cinder-b18e3807-bab9-4311-8110-fb40f962b496-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:03 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=54,cinder:INSERT=27,cinder:UPDATE=79,cinder:DELETE=7 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:18:03 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=76,cinder:DELETE=5,cinder:SELECT=62,cinder:INSERT=16 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Flow 'volume_create_manager' (f0a120f2-dda0-4d56-80de-62fa8503d0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fd05df-2a31-4dfa-937b-8e665a89276d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19fd05df-2a31-4dfa-937b-8e665a89276d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-406971014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f4ca85-99e2-43b0-9400-89432e690ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa88d9af01c4617906aa71c913bc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:05Z,use_quota=True,user_id='1e8b6177df06439693bcf87f61ecafdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f13a37ff-22a2-496d-b838-906537f5c566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f13a37ff-22a2-496d-b838-906537f5c566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3176756-5756-4152-890a-02f4db6dce6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3176756-5756-4152-890a-02f4db6dce6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22f4ca85-99e2-43b0-9400-89432e690ce3', 'volume_name': 'volume-22f4ca85-99e2-43b0-9400-89432e690ce3', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5139bd78-b2c3-4a13-a96d-19b51177dbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5139bd78-b2c3-4a13-a96d-19b51177dbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a96d9f-aff9-48c1-a376-ec76fc2ddb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:05 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Volume 22f4ca85-99e2-43b0-9400-89432e690ce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22f4ca85-99e2-43b0-9400-89432e690ce3', 'volume_size': 1} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-406971014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f4ca85-99e2-43b0-9400-89432e690ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa88d9af01c4617906aa71c913bc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:05Z,use_quota=True,user_id='1e8b6177df06439693bcf87f61ecafdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Creating volume 22f4ca85-99e2-43b0-9400-89432e690ce3 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:18:05 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-22f4ca85-99e2-43b0-9400-89432e690ce3 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:05 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-22f4ca85-99e2-43b0-9400-89432e690ce3 1073741824 Sep 17 15:18:05 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:05 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-22f4ca85-99e2-43b0-9400-89432e690ce3 1073741824" returned: 0 in 0.427s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-22f4ca85-99e2-43b0-9400-89432e690ce3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:05 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-22f4ca85-99e2-43b0-9400-89432e690ce3 Sep 17 15:18:05 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:05 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-22f4ca85-99e2-43b0-9400-89432e690ce3" returned: 0 in 0.247s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5a96d9f-aff9-48c1-a376-ec76fc2ddb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f4ca85-99e2-43b0-9400-89432e690ce3', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031ad315-6f3f-44e4-a731-a5a2aa2af508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:05 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Volume volume-22f4ca85-99e2-43b0-9400-89432e690ce3 (22f4ca85-99e2-43b0-9400-89432e690ce3): created successfully Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (031ad315-6f3f-44e4-a731-a5a2aa2af508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Flow 'volume_create_manager' (f0a120f2-dda0-4d56-80de-62fa8503d0ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:05 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4fc93d5a-d748-4a73-80c8-3f3737635411 tempest-ProjectReaderTests-853793953 None] Created volume successfully. Sep 17 15:18:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] Acquiring lock "cinder-22f4ca85-99e2-43b0-9400-89432e690ce3-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] Lock "cinder-22f4ca85-99e2-43b0-9400-89432e690ce3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] Acquiring lock "cinder-quobyte-22f4ca85-99e2-43b0-9400-89432e690ce3" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] Lock "cinder-quobyte-22f4ca85-99e2-43b0-9400-89432e690ce3" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5316d1-a872-4135-96b5-2407b316577d]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-22f4ca85-99e2-43b0-9400-89432e690ce3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:06 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-22f4ca85-99e2-43b0-9400-89432e690ce3 Sep 17 15:18:06 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:06 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-22f4ca85-99e2-43b0-9400-89432e690ce3" returned: 0 in 0.357s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-22f4ca85-99e2-43b0-9400-89432e690ce3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:06 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-22f4ca85-99e2-43b0-9400-89432e690ce3 Sep 17 15:18:06 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:06 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-22f4ca85-99e2-43b0-9400-89432e690ce3" returned: 0 in 0.246s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] Lock "cinder-quobyte-22f4ca85-99e2-43b0-9400-89432e690ce3" released by "delete_volume" :: held 0.645s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] Created reservations ['79dc2753-e349-4704-9d25-f6574a8db027', '917d1929-3ee4-4775-a06e-5ba7e97efab3', '77ce959f-9c88-4932-af71-c6f8d41bd99e', '6961e3f2-a1ed-4880-95d3-0cbd41edc5e1'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:07 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:18:07 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:07 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.252s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:18:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] Deleted volume successfully. Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2bd92253-9a97-4d87-b024-1b5e137f43d2 tempest-ProjectReaderTests-853793953 None] Lock "cinder-22f4ca85-99e2-43b0-9400-89432e690ce3-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Flow 'volume_create_manager' (4ab77f69-7c2d-45d3-bb89-8b5411f4b071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e7f20e-90fe-45b5-ab9b-ff7d8a24870e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53e7f20e-90fe-45b5-ab9b-ff7d8a24870e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-784869593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c3ce3a-f76e-44de-b4cf-1aca0ca5107c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa88d9af01c4617906aa71c913bc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:08Z,use_quota=True,user_id='1e8b6177df06439693bcf87f61ecafdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76216a41-8586-468a-a6a7-432d92cc8657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76216a41-8586-468a-a6a7-432d92cc8657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383934f2-1604-4c22-98bd-eb8884b7ff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (383934f2-1604-4c22-98bd-eb8884b7ff94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16c3ce3a-f76e-44de-b4cf-1aca0ca5107c', 'volume_name': 'volume-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32a60c5-a90e-4cc6-a51b-b790ecd19fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32a60c5-a90e-4cc6-a51b-b790ecd19fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddaddf9e-fde4-429a-b016-7494e7a8cf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:07 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Volume 16c3ce3a-f76e-44de-b4cf-1aca0ca5107c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c', 'volume_size': 1} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-784869593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c3ce3a-f76e-44de-b4cf-1aca0ca5107c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa88d9af01c4617906aa71c913bc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:08Z,use_quota=True,user_id='1e8b6177df06439693bcf87f61ecafdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Creating volume 16c3ce3a-f76e-44de-b4cf-1aca0ca5107c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:18:07 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:18:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:07 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c 1073741824 Sep 17 15:18:07 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:08 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c 1073741824" returned: 0 in 0.400s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:08 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c Sep 17 15:18:08 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:08 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c" returned: 0 in 0.251s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:18:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddaddf9e-fde4-429a-b016-7494e7a8cf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb07621-f821-4f6c-b629-85e10995f80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:08 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Volume volume-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c (16c3ce3a-f76e-44de-b4cf-1aca0ca5107c): created successfully Sep 17 15:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb07621-f821-4f6c-b629-85e10995f80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Flow 'volume_create_manager' (4ab77f69-7c2d-45d3-bb89-8b5411f4b071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:08 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1d621b1c-4637-4fc0-9baa-ee218c5bb3ed tempest-ProjectReaderTests-853793953 None] Created volume successfully. Sep 17 15:18:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] Acquiring lock "cinder-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] Lock "cinder-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] Acquiring lock "cinder-quobyte-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] Lock "cinder-quobyte-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c" acquired by "delete_volume" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:08 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30e5d39-8209-4daa-b1dd-432f6d86bf78]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:09 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c Sep 17 15:18:09 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:09 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c" returned: 0 in 0.338s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:09 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c Sep 17 15:18:09 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:09 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c" returned: 0 in 0.251s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] Lock "cinder-quobyte-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c" released by "delete_volume" :: held 0.626s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:09 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] Created reservations ['a0cf17dd-5826-4c6c-9588-9ba275a497cf', '6610a0ac-0e7f-468c-bdbe-9b3d3c6f823b', '83806770-5883-4139-ac99-6d5af6c89149', 'b3ec197c-2487-4a37-b471-db9016ed692a'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:09 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:18:09 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:09 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.250s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:09 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:18:09 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] Deleted volume successfully. Sep 17 15:18:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-30a6f849-ea4d-4601-bdff-1b27ac79e65b tempest-ProjectReaderTests-853793953 None] Lock "cinder-16c3ce3a-f76e-44de-b4cf-1aca0ca5107c-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Flow 'volume_create_manager' (e6fb483b-a6b0-4d02-b8e7-f8139127a8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b9638c-00ee-4859-866b-4d6089caa32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b9638c-00ee-4859-866b-4d6089caa32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1591186292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5fbf85-5de7-4920-8d59-e106048e76d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa88d9af01c4617906aa71c913bc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:10Z,use_quota=True,user_id='1e8b6177df06439693bcf87f61ecafdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4957378e-57d6-4162-8241-9dfc7217cdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4957378e-57d6-4162-8241-9dfc7217cdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ae8994-99f0-4528-ba1d-aa5b830e3dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ae8994-99f0-4528-ba1d-aa5b830e3dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be5fbf85-5de7-4920-8d59-e106048e76d1', 'volume_name': 'volume-be5fbf85-5de7-4920-8d59-e106048e76d1', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ad8275-61d6-4837-9aea-694c490a0a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ad8275-61d6-4837-9aea-694c490a0a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbd8a0d-883a-464c-bcee-7e49795e7224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:10 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Volume be5fbf85-5de7-4920-8d59-e106048e76d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be5fbf85-5de7-4920-8d59-e106048e76d1', 'volume_size': 1} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1591186292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5fbf85-5de7-4920-8d59-e106048e76d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa88d9af01c4617906aa71c913bc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:10Z,use_quota=True,user_id='1e8b6177df06439693bcf87f61ecafdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Creating volume be5fbf85-5de7-4920-8d59-e106048e76d1 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:18:10 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-be5fbf85-5de7-4920-8d59-e106048e76d1 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:10 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-be5fbf85-5de7-4920-8d59-e106048e76d1 1073741824 Sep 17 15:18:10 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:10 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-be5fbf85-5de7-4920-8d59-e106048e76d1 1073741824" returned: 0 in 0.402s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-be5fbf85-5de7-4920-8d59-e106048e76d1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:11 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-be5fbf85-5de7-4920-8d59-e106048e76d1 Sep 17 15:18:11 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:11 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-be5fbf85-5de7-4920-8d59-e106048e76d1" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:18:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbd8a0d-883a-464c-bcee-7e49795e7224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be5fbf85-5de7-4920-8d59-e106048e76d1', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a3f4f5-ed0b-4bee-9cfb-c7f1691837fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:11 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Volume volume-be5fbf85-5de7-4920-8d59-e106048e76d1 (be5fbf85-5de7-4920-8d59-e106048e76d1): created successfully Sep 17 15:18:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a3f4f5-ed0b-4bee-9cfb-c7f1691837fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Flow 'volume_create_manager' (e6fb483b-a6b0-4d02-b8e7-f8139127a8e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-81e6572a-57fa-49b0-9443-08d690b2f33e tempest-ProjectReaderTests-853793953 None] Created volume successfully. Sep 17 15:18:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] Acquiring lock "cinder-be5fbf85-5de7-4920-8d59-e106048e76d1-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] Lock "cinder-be5fbf85-5de7-4920-8d59-e106048e76d1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] Acquiring lock "cinder-quobyte-be5fbf85-5de7-4920-8d59-e106048e76d1" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] Lock "cinder-quobyte-be5fbf85-5de7-4920-8d59-e106048e76d1" acquired by "delete_volume" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:11 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2301514d-0fee-4426-909b-0d1e57dcfa70]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-be5fbf85-5de7-4920-8d59-e106048e76d1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:11 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-be5fbf85-5de7-4920-8d59-e106048e76d1 Sep 17 15:18:11 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:11 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-be5fbf85-5de7-4920-8d59-e106048e76d1" returned: 0 in 0.349s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-be5fbf85-5de7-4920-8d59-e106048e76d1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:11 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-be5fbf85-5de7-4920-8d59-e106048e76d1 Sep 17 15:18:11 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:12 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-be5fbf85-5de7-4920-8d59-e106048e76d1" returned: 0 in 0.251s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] Lock "cinder-quobyte-be5fbf85-5de7-4920-8d59-e106048e76d1" released by "delete_volume" :: held 0.640s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:12 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] Created reservations ['e4ab1100-5b21-4c2f-b062-a62daed7f145', '42d975b0-68f6-405d-8a33-826c370d2f0a', '8cb1b729-5a5b-4c74-8543-4d8c1d39403b', '62b237b9-e7ef-4a10-82b8-1eb93b44c821'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:12 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:18:12 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:12 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.245s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:12 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:18:12 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] Deleted volume successfully. Sep 17 15:18:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fbdc555b-f83f-4dac-ae84-eb72c91da7a3 tempest-ProjectReaderTests-853793953 None] Lock "cinder-be5fbf85-5de7-4920-8d59-e106048e76d1-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Flow 'volume_create_manager' (bf0e461c-1118-4fe9-ab65-d7b129f6c5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7be42c-aeb6-4d32-9cc3-8dd60ff54f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d7be42c-aeb6-4d32-9cc3-8dd60ff54f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1129155257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaad41d0-602d-4422-a0b5-19427c230846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa88d9af01c4617906aa71c913bc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:13Z,use_quota=True,user_id='1e8b6177df06439693bcf87f61ecafdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82b825b-a256-4f7f-b7d9-49f8944ae60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82b825b-a256-4f7f-b7d9-49f8944ae60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612cf356-35e5-4dad-8220-e4e0418c6a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612cf356-35e5-4dad-8220-e4e0418c6a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaad41d0-602d-4422-a0b5-19427c230846', 'volume_name': 'volume-aaad41d0-602d-4422-a0b5-19427c230846', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03e4132-08df-4815-90fc-5c0fc775e266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03e4132-08df-4815-90fc-5c0fc775e266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4848425c-9bfa-426c-b3b8-5bf3325ec6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:13 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Volume aaad41d0-602d-4422-a0b5-19427c230846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaad41d0-602d-4422-a0b5-19427c230846', 'volume_size': 1} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1129155257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaad41d0-602d-4422-a0b5-19427c230846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffa88d9af01c4617906aa71c913bc578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:13Z,use_quota=True,user_id='1e8b6177df06439693bcf87f61ecafdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f380eb3-8ed3-4f1f-8635-e3d7d44291d0),volume_type_id=8f380eb3-8ed3-4f1f-8635-e3d7d44291d0)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Creating volume aaad41d0-602d-4422-a0b5-19427c230846 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Selected osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:18:13 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] casted to osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813 Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aaad41d0-602d-4422-a0b5-19427c230846 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:13 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aaad41d0-602d-4422-a0b5-19427c230846 1073741824 Sep 17 15:18:13 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:13 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aaad41d0-602d-4422-a0b5-19427c230846 1073741824" returned: 0 in 0.397s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aaad41d0-602d-4422-a0b5-19427c230846 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:13 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aaad41d0-602d-4422-a0b5-19427c230846 Sep 17 15:18:13 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:13 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aaad41d0-602d-4422-a0b5-19427c230846" returned: 0 in 0.240s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4848425c-9bfa-426c-b3b8-5bf3325ec6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaad41d0-602d-4422-a0b5-19427c230846', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e943581b-6ffc-4c36-b02b-61b596c2b6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:13 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Volume volume-aaad41d0-602d-4422-a0b5-19427c230846 (aaad41d0-602d-4422-a0b5-19427c230846): created successfully Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e943581b-6ffc-4c36-b02b-61b596c2b6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Flow 'volume_create_manager' (bf0e461c-1118-4fe9-ab65-d7b129f6c5de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:13 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8252eb1c-416d-42b8-9cf5-11336b81a421 tempest-ProjectReaderTests-853793953 None] Created volume successfully. Sep 17 15:18:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] Acquiring lock "cinder-aaad41d0-602d-4422-a0b5-19427c230846-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] Lock "cinder-aaad41d0-602d-4422-a0b5-19427c230846-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] Acquiring lock "cinder-quobyte-aaad41d0-602d-4422-a0b5-19427c230846" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] Lock "cinder-quobyte-aaad41d0-602d-4422-a0b5-19427c230846" acquired by "delete_volume" :: waited 0.012s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:14 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[993c3340-1360-4c25-93c3-4f178fa5bebf]: (4, 'qcow2') {{(pid=87740) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aaad41d0-602d-4422-a0b5-19427c230846 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:14 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aaad41d0-602d-4422-a0b5-19427c230846 Sep 17 15:18:14 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:14 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aaad41d0-602d-4422-a0b5-19427c230846" returned: 0 in 0.368s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aaad41d0-602d-4422-a0b5-19427c230846 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:14 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aaad41d0-602d-4422-a0b5-19427c230846 Sep 17 15:18:14 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:14 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d/volume-aaad41d0-602d-4422-a0b5-19427c230846" returned: 0 in 0.264s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] Lock "cinder-quobyte-aaad41d0-602d-4422-a0b5-19427c230846" released by "delete_volume" :: held 0.669s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:14 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] Created reservations ['6ae09447-6e26-4967-8a48-5bc07ec7f8f9', 'b61d6e7b-aa54-450c-b5bd-0f04afee3125', '72b7ebdb-7413-40e1-b469-74b5b56f2547', '9217f127-beeb-424d-afe2-87c5506ab660'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:15 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d Sep 17 15:18:15 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:15 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d" returned: 0 in 0.245s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:15 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:18:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] Deleted volume successfully. Sep 17 15:18:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-351aad31-d3df-432a-9a5e-3b9e4d9d8a21 tempest-ProjectReaderTests-853793953 None] Lock "cinder-aaad41d0-602d-4422-a0b5-19427c230846-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:24 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=32,cinder:INSERT=10,cinder:UPDATE=44,cinder:DELETE=2 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:18:25 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=44,cinder:SELECT=24,cinder:DELETE=6,cinder:INSERT=10 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:18:40 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:18:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-26481520-711e-4333-9b3c-647e34e81813'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-214dc4de-8dc7-451b-86ac-bdeef40fa3b5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30c48455f0f8bb043e322bac78db613d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}